Senior Big Data Engineer
Software Development Advanced level ability in software development Function as member of an agile team by contributing to software builds through consistent development practices (tools, common components, and documentation) Participate in code reviews and automated testing. Debug basic software components and identify code defects for remediation. Enable the deployment, support, and monitoring of software across test, integration, and production environments. Automate deployments in test or production environments. Automatically scale applications based on demand projections. Leadership Opportunity to lead a small team of developers and empower them to achieve their potential. Influence team members with creative changes and improvements by challenging status quo and demonstrating risk taking. Objectives of this Role Develop and implement data pipelines that extracts, transforms, and loads data into an information product that helps to inform the organization in reaching strategic goals. Work on ingesting, storing, processing, and analyzing large data sets. Create scalable and high-performance web services for tracking data. Translate complex technical and functional requirements into detailed designs. Investigate and analyze alternative solutions to data storing, processing etc. to ensure most streamlined approaches are implemented. Develops and tests software, including ongoing refactoring of code & drives continuous improvement in code structure & quality. Primary focus is spent writing code, API specs, conducting code reviews & testing in ongoing sprints or doing proof of concepts/automation tools. Functions as a core member of an Agile team driving User story analysis & elaboration, design and development of software applications, testing & builds automation tools. Works on a specific platform/product or as part of a dynamic resource pool assigned to projects based on demand and business priority. Finds opportunities to adopt innovative technologies. Minimum
Qualifications:
Over all 6-8 years of experience in Hadoop & Big Data along with 2-3 year of experience in AWS Cloud. Demonstrated experience with Agile or other rapid application development methods. Minimum 4 years of experience with Big Data Components/Frameworks (Hadoop, HBase, MapReduce, HDFS, Pig, Hive, Sqoop, Flink, oozie, Flink, Spark, etc.) and java programming languages. Experience in AWS Redshift, Lake house, Database Migration Service, Glue, EMR, Elastic Compute Cloud (EC2), S3, Relational Expert on Distributed ecosystem Hands-on experience with programming using Core Java or Python/Scala Expert on Hadoop and Spark Architecture and its working principle Hands on working experience on Hive, Shell scripting. Understanding of data warehousing and data modeling techniques Strong data engineering skills on the AWS Cloud Platform is essential. Hands-on expertise with application design, software development, and automated testing Must have 3
years of demonstrated experience leading teams of engineers. Experience with RESTful web services, open API development, and SOA concepts Experience with parallel and distributed (multi-tiered) systems, algorithms, message queuing, and relational databases. Knowledge of Travel data is a plus. Ability to design and develop optimized Data pipelines for batch and real time data processing using Spark/Flink. Should have experience in analysis, design, development, testing, and implementation of system applications. Demonstrated ability to develop and document technical and functional specifications and analyze software and system processing flows. Excellent technical and analytical proficiency Good communication skills Excellent Project management skills. Results driven. Senior Big Data Engineer Recommended Skills Api Agile Methodology Algorithms Amazon S3 Analytical Apache Flink Apply to this job. Think you're the perfect candidate? Apply on company site $(document).ready( function() $(#ads-desktop-placeholder).html(
n
n
n Estimated Salary: $20 to $28 per hour based on qualifications.
Qualifications:
Over all 6-8 years of experience in Hadoop & Big Data along with 2-3 year of experience in AWS Cloud. Demonstrated experience with Agile or other rapid application development methods. Minimum 4 years of experience with Big Data Components/Frameworks (Hadoop, HBase, MapReduce, HDFS, Pig, Hive, Sqoop, Flink, oozie, Flink, Spark, etc.) and java programming languages. Experience in AWS Redshift, Lake house, Database Migration Service, Glue, EMR, Elastic Compute Cloud (EC2), S3, Relational Expert on Distributed ecosystem Hands-on experience with programming using Core Java or Python/Scala Expert on Hadoop and Spark Architecture and its working principle Hands on working experience on Hive, Shell scripting. Understanding of data warehousing and data modeling techniques Strong data engineering skills on the AWS Cloud Platform is essential. Hands-on expertise with application design, software development, and automated testing Must have 3
years of demonstrated experience leading teams of engineers. Experience with RESTful web services, open API development, and SOA concepts Experience with parallel and distributed (multi-tiered) systems, algorithms, message queuing, and relational databases. Knowledge of Travel data is a plus. Ability to design and develop optimized Data pipelines for batch and real time data processing using Spark/Flink. Should have experience in analysis, design, development, testing, and implementation of system applications. Demonstrated ability to develop and document technical and functional specifications and analyze software and system processing flows. Excellent technical and analytical proficiency Good communication skills Excellent Project management skills. Results driven. Senior Big Data Engineer Recommended Skills Api Agile Methodology Algorithms Amazon S3 Analytical Apache Flink Apply to this job. Think you're the perfect candidate? Apply on company site $(document).ready( function() $(#ads-desktop-placeholder).html(
n
n
n Estimated Salary: $20 to $28 per hour based on qualifications.
|
|
 | |
