About the Job:

Apex-Consultant is an innovative company dedicated to delivering exceptional Software & IT Consultancy Services to our clients. Our team thrives on creativity, collaboration, and thinking outside the box to drive brand awareness and leads. We’re looking for a detail-oriented Senior Data Engineer to join our quickly growing team.

As a Data Engineer at Apex- Consultant, you’ll be accountable for building and executing data solutions that help our organization achieve its goals. Strong technical proficiency, critical thinking, and the ability to adjust to deadline pressure are qualities of successful candidates.

***This position allows for flexible hours and requires remote work. Please don’t apply if you can’t commit to these requirements. Thank you in advance. ***

Skills associated with the job post:

• AWS/Azure
• Typescript
• CI/CD
• Python
• Scala
• Data Analytics
• Data Lakes
• Data Warehousing
• Databases (SQL, MySQL, or any other like them)
• Cloud-based data storage
• ETL

Key Responsibilities:

• Design, develop, and maintain scalable and efficient data pipelines for ingesting, processing, and transforming data from various sources into a unified data platform.
• Collaborate with cross-functional teams, including data analysts, data scientists, and business stakeholders, to understand data requirements and deliver insights.
• Optimize data processing workflows for performance, reliability, and cost-effectiveness.
• Implement and maintain data quality checks and monitoring systems to ensure data integrity.
• Automate data pipeline deployment and management using DevOps practices and tools.
• Provide technical leadership and mentorship to junior data engineers.
• Stay up-to-date with the latest trends and best practices in data engineering and cloud technologies.

Minimum Technical Requirements:

• 5 + years of experience as a data engineer or in a similar role.
• Proficient in Python, SQL, and data processing frameworks like Apache Spark.
• Hands-on experience with ETL tools like Airflow, Prefect, or Dagster.
• Expertise in designing and implementing data pipelines in cloud environments (AWS, GCP, or Azure).
• Experience in ETL orchestration and workflow management tools like Airflow, flink, etc. using AWS/GCP (i.e., Airflow, Luigi, Prefect, Dagster, digdag.io, Google Cloud Composer, AWS Step Functions, Azure Data Factory, UC4, Control-M).
• Strong understanding of data modeling techniques and best practices.
• Familiarity with cloud-native data storage solutions (e.g., Amazon S3, Google BigQuery, Azure Blob Storage).
• Experience with containerization and orchestration tools like Docker and Kubernetes.
• Familiarity with version control systems like Git and collaboration tools like GitHub.
• Knowledge of data security best practices and compliance requirements.
• Bachelor’s degree in Computer Science, Information Technology, or related field.

Essential Cultural Traits:

• Collaborative and communicative: Able to work effectively with cross-functional teams and stakeholders.
•  Proactive and solution-oriented: Takes initiative to identify and solve problems.
• Adaptable and flexible: Comfortable with change and open to learning new technologies.
• Detail-oriented and organized: Pays attention to quality and ensures data pipeline reliability.
• Passionate about data and technology: Continuously learns and stays up-to-date with industry trends.

Non-Technical Requirements:

• Strong analytical and problem-solving skills.
• Excellent written and verbal communication skills.
• Ability to translate business requirements into technical solutions.
• Project management skills to coordinate and deliver data engineering projects.
• Willingness to learn and adapt to new technologies and best practices.

If you meet these requirements and are excited to join a dynamic team of data professionals, we encourage you to apply for this position. We offer competitive compensation, opportunities for growth, and a collaborative work environment.