Data Engineer with Databricks (Remote)

This job was posted over 30 days ago, so it has most likely closed. See newer jobs like it.

Written by AI from the job title and company, not by Loginsoft, so some details may not match this job. The employer's own page has the real description.

Job Overview

Loginsoft is seeking an experienced Data Engineer with proficiency in Databricks to join our dynamic team in a remote capacity. The successful candidate will play a crucial role in designing and implementing robust data pipelines, ensuring data integrity, and optimizing data workflows. This position involves collaboration with data scientists and analysts to deliver secure and efficient solutions that meet our business needs while utilizing cutting-edge technology.

Job Responsibilities

• Design, build, and maintain scalable data pipelines using Databricks.
• Collaborate with data scientists and analysts to define data requirements.
• Monitor and troubleshoot data processing jobs to ensure data accuracy and performance.
• Implement data quality checks and optimize existing workflows for efficiency.
• Ensure compliance with data governance and security policies.
• Document technical specifications and develop best practices for data management.
• Stay updated on industry trends and emerging technologies related to big data.

Qualifications

• Bachelor's degree in Computer Science, Information Technology, or related field.
• Minimum of 3 years of experience in data engineering or related roles.
• Proficiency in Databricks and Apache Spark.
• Strong programming skills in Python, SQL, or Scala.
• Experience with data warehousing solutions and ETL processes.
• Familiarity with cloud platforms such as AWS, Azure, or Google Cloud.
• Experience with version control systems like Git.
• Excellent analytical and problem-solving skills.

Technologies & Tools

As a Data Engineer at Loginsoft, you will be working extensively with Databricks for data processing, alongside various big data technologies including Apache Spark, SQL databases, and cloud services such as AWS or Azure. Familiarity with CI/CD tools and data orchestration frameworks will also be advantageous in this role, as you will facilitate seamless data integration and processing workflows.

Ideal Candidates

The ideal candidate will possess a passion for data, couple analytical skills with a strong attention to detail, and demonstrate an ability to work collaboratively in a fast-paced environment. An innovative mindset and the capacity to adapt to new technologies will be valued, as well as excellent communication skills to liaise effectively with cross-functional teams. A proactive approach to problem-solving and a commitment to quality will further distinguish you as a suitable candidate for this position.