Data Engineer

Req number:

R2641

Employment type:

Full time

Worksite flexibility:

Remote

Who we are

CAI is a global technology services firm with over 8,500 associates worldwide and a yearly revenue of $1 billion+. We have over 40 years of excellence in uniting talent and technology to power the possible for our clients, colleagues, and communities. As a privately held company, we have the freedom and focus to do what is right—whatever it takes. Our tailor-made solutions create lasting results across the public and commercial sectors, and we are trailblazers in bringing neurodiversity to the enterprise.

Job Summary

We are looking for a Data Engineer. This position will be full-time.

Job Description

What You’ll Do

• Involve in Design and Development in all phases of project.

• Apply analytical and technical skills to create an efficient data operation.

• Responsible for the Data Quality and Data validation.

• Collaborate with team members and other data experts to create a high-functioning process.

• Handling of Production & Administration activities.

What You'll Need

• Minimum of 2 years’ experience in working with Spark and Data frames using Python.

• Experience writing batch pipelines using Spark.

• Experience to handle Semi/Un-Structured data using PySpark or Python.

• Experience working with Delta lake.

• Proficient on performance optimization techniques on Spark jobs.

• Working experience with DevOps environment is an added advantage.

• Proficiency in testing methodologies and validating data pipelines.

• Proficient in SQL and database management systems.

• Experience with working on Data Lake, Star Schema etc.

• Demonstrated capability in constructing scalable data pipelines and ETL processes.

• Familiarity with data warehousing, data quality assurance, and monitoring practices.

• Working knowledge of any one of the public cloud platforms preferably Azure.

Physical Demands

• Sedentary work that involves sitting or remaining stationary most of the time with occasional need to move around the office to attend meetings, etc.

• Ability to conduct repetitive tasks on a computer, utilizing a mouse, keyboard, and monitor

Reasonable accommodation statement

If you require a reasonable accommodation in completing this application, interviewing, completing any pre-employment testing, or otherwise participating in the employment selection process, please direct your inquiries to application.accommodations@cai.io or (888) 824 – 8111.