Job Description:
We are seeking an experienced Data Engineer to join our team and play a critical role in designing, building, and maintaining advanced data infrastructure projects. This position requires a deep understanding of both the technical and strategic aspects of data engineering.
Core Responsibilities:
- Design, build, and maintain scalable and complex data pipelines and architectures to support business needs.
- Enhance data collection and storage solutions by developing and optimizing SQL and Python scripts and integrating various database systems, including PostgreSQL, MySQL, and NoSQL platforms like MongoDB and Cassandra.
- Implement robust ETL processes using tools such as Talend, Alteryx, and Apache Nifi.
- Work with big data technologies, particularly Spark, and employ advanced data modeling techniques to improve system efficiency and performance.
- Manage data storage and processing in cloud environments, ensuring security and compliance with best practices.
- Conduct data cleansing, preparation, and optimization tasks to enhance analytics and reporting capabilities.
- Design, build, and maintain secure data lakes and data warehousing solutions.
- Collaborate with cross-functional teams, including non-technical stakeholders, to deliver data-driven solutions and insights, ensuring seamless communication and integration.
- Maintain a keen understanding of data governance and security best practices
Required Skills and Qualifications:
- Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
- 3-5 years of proven experience in data engineering.
- Strong proficiency in database programming, particularly SQL, Python, and Scala.
- Extensive experience with relational databases like PostgreSQL, MySQL, and NoSQL databases such as MongoDB and Cassandra.
- Expertise in ETL processes and familiarity with specific ETL tools.
- Familiarity with big data technologies, particularly Apache Spark.
- Experience with cloud services for data processing and storage.
- Strong analytical and problem-solving skills.
Preferred Skills:
- Experience with API development and data visualization tools like Tableau or PowerBI.
- Knowledge of machine learning frameworks and predictive modeling.
- Certifications in data management (CDMP) or specific platforms (AWS, Microsoft).
- Excellent project management capabilities.
- Knowledge in Cybersecurity Data is a plus
Additional Attributes:
- Strong communication skills to interact effectively with both technical and non-technical stakeholders.
- Ability to adapt quickly to new technologies and changing business needs.
- Passion for continuous learning and innovation.
How to Apply:
Please submit your resume and a cover letter detailing your experience and how it aligns with the requirements and expectations outlined above. Send applications to: career@synist.net