We are seeking a skilled and motivated Data Engineer to join our global and innovative team of data professionals. The ideal candidate will have extensive experience with SQL Databases, ETL processes, Python programming, Kubernetes, GitHub, and system monitoring. This role involves modernizing, designing, developing, and maintaining our backend manufacturing data architecture. You will work closely with various teams to understand data requirements and deliver solutions that drive business insights and efficiencies.
Key Responsibilities:
-
Programming:
- Write clean, efficient, and maintainable code for data manipulation and automation tasks.
- Ability to read, debug, support and improve code written by other developers.
- Develop and implement data processing scripts and workflows.
- Use GitHub for version control, code reviews, CI/CD, and collaboration with team members.
-
Kubernetes:
- Deploy and manage containerized applications using Kubernetes.
- Ensure the scalability, reliability, and performance of data infrastructure on Kubernetes.
-
Databases:
- Manage and optimize databases in SingleStore, Microsoft SQL, and MySQL environments.
- Ensure data integrity, security, and performance across database systems.
-
ETL Processes:
- Design, develop, and maintain ETL pipelines to ensure seamless data flow across various sources and destinations.
- Optimize ETL processes for performance, scalability, and reliability.
-
Monitoring and Logging:
- Implement and configure monitoring solutions to track system performance, data pipelines, and applications.
- Set up alerts and dashboards to proactively address issues and ensure system health and best practices.
Required Qualifications:
- Bachelor’s degree in Computer Science, Information Technology, or a related field.
- Proven experience as a Data Engineer or in a similar role.
- Experience with SingleStore, Microsoft SQL, and MySQL databases.
- Strong proficiency in ETL tools and processes.
- Expertise in Python and C# programming languages.
- Experience with Azure and cloud services.
- Proficiency with container orchestration using Kubernetes.
- Familiarity with version control systems and CI/CD, particularly GitHub and GitHub Actions.
- Knowledge of monitoring tools like Datadog or Grafana.
- Excellent problem-solving skills and attention to detail.
- Strong communication and collaboration skills.
Preferred Qualifications:
- Familiarity with data virtualization
- Proficiency with project tracking tools, preferably Jira.
- Excellent problem-solving skills and attention to detail.
- Active listening skills, including investigating requirements and proactively identifying potential issues.
- Critical thinker who naturally see opportunities to develop and optimize work processes - finding ways to simplify, standardize and automate.
- Self-directed imitator. People who take ownership of their work and need no prompting to drive productivity, change, and outcomes.
- Collaborative partner. Someone who build and leverage cross-functional relationships to bring together ideas, data, and insights to drive continuous improvement in execution.
- Analytical problem solvers. People who go beyond just fixing to identify root causes, evaluate optimal solutions, and recommend comprehensive upgrades to prevent future issues.
- Dedicated achiever. Someone who thrive in a fast-paced environment and will stop at nothing to ensure a project is completed and meets regulations.
- Ability to manage multiple tasks and prioritize effectively.
- Strong communication and teamwork abilities.
Provide expertise on database management/design to drive integration of business data, functions, and systems. Establish standards, guidelines, procedures, and other infrastructure necessary to support the objective of integration of data. Resolve performance problems. Plans and schedules daily tasks, uses judgement on a variety of problems requiring deviation from standard practices. Inadequacies and erroneous decisions would cause moderate inconvenience and expense.
