You are signing up for Big Data Engineer
About the role
The Big data engineer will be part of a global Analytics team implementing and supporting leading-edge analytical solutions on Hadoop Clusters. As a big-data tools Administrator, you should be passionate about system administration learning new technologies, and willing to improve and support Hadoop clusters on-prem and in cloud. Considering that we are working in distributed teams between United States, India and Chile to perform research and development on how to improve our analytical assets in USA, Australia, Europe, Canada and Latin America, you should be a team player and have flexibility to work in moving time spans, given the time zone differences between countries.
As a Big data engineer, you are responsible for the following roles:
- Be able to install and update various analytical tools required (ex. RStudio, Anaconda Notebooks, Tableau, SAS, and Spotfire).
- Be able to troubleshoot issues with analytical tools and clearly explain the same to other admins and tool vendors.
- Create documentation of installations, user onboarding, and best practices. Ensure that procedures and infrastructure details are properly documented and shared among the team.
- Interact with users continuously to address their issues and search for the optimum usage pattern to propagate.
- Troubleshooting issues, performance tuning, security remediation/patch management, Upkeep of the platforms.
- Deploy/implement new instances of our financial product (Customer facing Analytical platform) in the cloud through cloud formation templates and/or the on-prem setup.
- Ensure that every cluster and services, are always available without performance issues, using monitoring and alerting tools.
- Learn about all the technologies involved in the project. We expect our engineers to be well rounded and be able to support end-to-end solutions.
- Work in a privileged account security architecture, caring about all the security policies involved.
- Propose new and better ways to solve problems from a technology view or process view. Be part of the technical and procedural solutions being worked by the team.