Software Engineer - Data Infrastructure - OpenSearch/ElasticSearch

This job was posted over 30 days ago, so it has most likely closed. See newer jobs like it.

Written by AI from the job title and company, not by Jobs via Dice, so some details may not match this job. The employer's own page has the real description.

Job Overview

We are seeking a highly skilled Software Engineer specializing in Data Infrastructure with experience in OpenSearch or ElasticSearch to join our dynamic team at Jobs via Dice. The candidate will be responsible for designing, developing, and optimizing our data architecture to support high-volume, high-frequency data workflows. This role will involve collaborating with cross-functional teams to implement robust and scalable data solutions, ensuring reliability and performance of data systems while employing best practices in software engineering.

Job Responsibilities

• Design and implement scalable data architecture and pipelines using OpenSearch or ElasticSearch.
• Optimize and manage data storage, retrieval, and processing strategies to enhance system performance.
• Collaborate with data scientists and analysts to understand data requirements and deliver effective solutions.
• Monitor system performance and troubleshoot issues related to data infrastructure.
• Develop automated solutions for data ingestion and transformation processes.
• Write clean, maintainable, and efficient code while adhering to industry best practices.
• Stay updated with the latest technologies and trends in data engineering and architecture.

Qualifications

• Bachelor's degree in Computer Science, Engineering, or a related field; Master's degree is a plus.
• Proven experience in software engineering, particularly in data infrastructure roles.
• Strong knowledge of OpenSearch and/or ElasticSearch technologies.
• Proficiency in programming languages such as Java, Python, or Go.
• Experience with data processing frameworks like Apache Spark or Apache Kafka.
• Familiarity with cloud platforms (AWS, Azure, Google Cloud) is highly desirable.
• Excellent problem-solving skills and ability to work in a fast-paced environment.

Technologies & Tools

In this position, candidates will primarily work with OpenSearch and ElasticSearch for data indexing, storage, and search capabilities. Additionally, proficiency in programming languages such as Java and Python is essential for developing backend services. Experience with data processing frameworks like Apache Spark and tools like Docker and Kubernetes will also be valuable for efficient data management and infrastructure automation.

Ideal Candidates

The ideal candidates for this role will possess a strong combination of technical expertise and problem-solving abilities, along with excellent communication and teamwork skills. They should be proactive and innovative thinkers who thrive in collaborative environments, adapt to changing demands, and are committed to continuous improvement in their technical skillset. A passion for data-driven decision-making and a desire to contribute to impactful projects are key traits that will set successful candidates apart.