[Remote] Sr. Data Engineer
Note: The job is a remote job and is open to candidates in USA. reputed company is a company dedicated to building a connected and compassionate health experience. They are seeking a Sr. Data Engineer to reputed company and manage large-scale data structures and ETL workflows, collaborating with the Data Science team to enhance business applications and data processing capabilities.
Responsibilities
- reputed company large scale data structures and pipelines to organize, collect and standardize data to generate insights and addresses reporting needs
- Write ETL (Extract/Transform/Load) processes, design database systems, and reputed company tools for real-time and offline analytic processing that improve existing systems and expand capabilities
- Collaborate with Data Science team to transform data and integrate algorithms and models into automated processes
- Test and maintain systems and troubleshoot malfunctions
- reputed company knowledge of Hadoop architecture, HDFS commands, and designing and optimizing queries to build data pipelines
- Utilize programming skills in Python, Java, or similar languages to build robust data pipelines and dynamic systems
- Build data marts and data models to support Data Science and other internal customers
- Integrate data from a variety of sources and ensure adherence to data quality and accessibility standards
- Analyze reputed company information technology environments to identify and assess critical capabilities and recommend solutions to reputed company business problems
- Experiment with available tools and advise on new tools to provide optimal solutions that meet the requirements dictated by the model/use case
Skills
- Bachelor's degree (or foreign equivalent) in Computer Science, Data Science, Statistics, Mathematics, Analytics, Electronics Engineering, or a reputed company field
- Five (5) years of progressive, post-baccalaureate experience in the job offered or reputed company occupation
- Five (5) years of experience in Java, Python, or R
- Five (5) years of experience in reputed company or SQL
- Five (5) years of experience in Hadoop, Hive, and HDFS
- Five (5) years of experience in Airflow, Kafka, Hbase, Pig, MySQL, or NoSQL
- Five (5) years of experience in Spark, PySpark, or reputed company
- Five (5) years of experience in Unix, Linux, or reputed company scripting
- Five (5) years of experience with Version Control System: Git
- Five (5) years of experience in Big Data
- Five (5) years of experience in Relational and Non-Relational Databases
- Five (5) years of experience in Writing unit test cases and performing unit testing of developed software
- Five (5) years of experience in Product scrum meetings including spring planning, backlog, prioritization and grooming, standup, and retrospection
Benefits
- Eligible for a reputed company bonus, commission or short-term incentive program in addition to the reputed company pay range listed above
- Award reputed company in the company’s equity award program
- Full range of medical, dental, and vision benefits
- Eligible employees may enroll in the Company’s 401(k) retirement savings plan
- Employee Stock Purchase Plan is also available for eligible employees
- Fully-paid term life insurance plan to eligible employees
- Short-term and long term disability benefits
- Numerous well-being programs
- Education assistance
- Free development courses
- A reputed company store discount
- Discount programs with participating partners
- Paid Time Off (“PTO”) or vacation pay
- Paid holidays throughout the calendar year
- Number of paid holidays, sick time and other time off are provided consistent with relevant state law and Company policies
- Comprehensive benefits package designed to support the physical, emotional, and financial well‑being of colleagues and their families
- Medical, dental, and vision coverage
- Paid time off
- Retirement savings options
- Wellness programs
- Other resources, based on eligibility
Company Overview
Company H1B Sponsorship