Job Description
This job was posted over 30 days ago, so it has most likely closed. See newer jobs like it.
Written by AI from the job title and company, not by myGwork - LGBTQ+ Business Community, so some details may not match this job. The employer's own page has the real description.
Job Overview
The Senior Data Platform Engineer at myGwork will play a crucial role in designing, building, and maintaining robust data infrastructure to support data-driven decisions within the organization. This position involves working collaboratively with cross-functional teams to ensure the smooth operation of data pipelines, optimization of data storage solutions, and implementation of data governance practices. The ideal candidate will leverage their expertise in big data technologies to enhance our data platform's scalability, security, and efficiency, thereby enabling the organization to maximize the value derived from its data assets.
Job Responsibilities
- Design and implement scalable and efficient data pipelines and architectures to facilitate data ingestion, processing, and storage.
- Collaborate with data scientists, analysts, and other stakeholders to understand their data needs and optimize data solutions accordingly.
- Monitor and fine-tune data platform performance to ensure high availability and reliability.
- Establish data governance policies and practices to ensure data quality, consistency, and security.
- Evaluate and integrate new data technologies and tools to enhance the existing data infrastructure.
- Assist in troubleshooting and resolving data-related issues in a timely manner.
- Provide mentorship and guidance to junior engineers and data professionals.
Qualifications
- Bachelor’s degree in Computer Science, Information Technology, or a related field; Master’s degree preferred.
- A minimum of 5 years of experience in data engineering or related roles, with a proven track record in handling large scale data systems.
- Proficiency in programming languages such as Python, Java, or Scala.
- Strong experience with big data technologies, including Apache Hadoop, Spark, Kafka, etc.
- Extensive knowledge of database management systems, both SQL (e.g., PostgreSQL, MySQL) and NoSQL (e.g., MongoDB, Cassandra).
- Experience with cloud platforms (e.g., AWS, Azure, Google Cloud) and their associated data services.
- Excellent problem-solving skills and the ability to work collaboratively in a team environment.
Technologies & Tools
The Senior Data Platform Engineer will utilize a range of technologies and tools, including but not limited to Apache Hadoop, Apache Spark, Kafka, SQL and NoSQL databases, containerization technologies like Docker and Kubernetes, cloud platforms such as AWS or Azure, and data visualization tools. Familiarity with CI/CD tools and practices is also essential to ensure seamless integration and deployment of data solutions.
Ideal Candidates
The ideal candidate for this position will have a strong analytical mindset, a passion for working with data, and a demonstrated ability to drive innovative solutions in a fast-paced environment. They should be committed to fostering an inclusive workplace where diversity is celebrated. The candidate must exhibit strong communication skills, both verbal and written, and possess the ability to explain complex technical concepts to non-technical stakeholders. Additionally, a proactive approach to problem-solving and a continual learning mindset are key attributes that will contribute to their success in this role.
Your LinkedIn About section is where you say what you do and what you are looking for. Type your job and a few facts, and pick from five drafts. Write an About section →
View Similar Jobs
Similar jobs which you may be interested in. Typically using your existing skillset.