Full Time

Senior Data Engineer

Big Cloud
$110,000 - $150,000* / year (about $53–$72 an hour)

Job Description

This job was posted over 30 days ago, so it has most likely closed. See newer jobs like it.

Written by AI from the job title and company, not by Big Cloud, so some details may not match this job. The employer's own page has the real description.

Job Overview


As a Senior Data Engineer at Big Cloud, you will play a crucial role in designing, constructing, and maintaining our data architecture and infrastructure. You will work closely with data scientists, analysts, and other stakeholders to ensure that our data pipelines are robust, reliable, and scalable. Your expertise will contribute to the development of data solutions that support business intelligence, analytics, and data-driven decision-making across the organization.



Job Responsibilities

  • Design and implement efficient, scalable data pipelines for ETL (Extract, Transform, Load) processes.
  • Collaborate with cross-functional teams to gather requirements and translate them into technical specifications.
  • Optimize and maintain existing data storage solutions and databases for performance and reliability.
  • Ensure data quality and governance by implementing best practices and adhering to compliance standards.
  • Develop and automate data ingestion processes from various sources, including APIs and databases.
  • Conduct performance tuning and optimization of data systems to facilitate access and usability.
  • Mentor junior data engineers and contribute to the professional development of the engineering team.
  • Evaluate and implement new data technologies and tools to enhance data processing capabilities.


Qualifications

  • Bachelor's degree in Computer Science, Information Technology, or a related field; Master’s degree preferred.
  • Minimum of 5 years of experience in data engineering or a related role.
  • Strong proficiency in SQL and experience with both relational and NoSQL databases.
  • Experience with data warehousing solutions, such as Snowflake, Amazon Redshift, or Google BigQuery.
  • Knowledge of programming languages such as Python, Java, or Scala.
  • Familiarity with big data technologies like Apache Spark, Kafka, or Hadoop.
  • Understanding of data modeling, architecture, and data lifecycle management.
  • Excellent problem-solving, analytical, and communication skills.


Technologies & Tools


In this position, you will work with various technologies and tools to manage and manipulate data effectively. This includes data integration tools such as Apache NiFi and Talend, cloud platforms like AWS and Azure for cloud storage and data processing, as well as visualization tools like Tableau or Power BI. Familiarity with containerization technologies like Docker and orchestration tools such as Kubernetes is also desirable, as these enhance the deployment and management of data solutions.



Ideal Candidates


The ideal candidate for the Senior Data Engineer position at Big Cloud will possess a strong combination of technical knowledge and interpersonal skills. They are proactive problem solvers who thrive in a fast-paced environment and can effectively manage multiple projects. A collaborative mindset and the ability to work well in a team are essential, as is a commitment to continuous improvement and learning. Furthermore, candidates should demonstrate a passion for data and how it can be leveraged to drive business success, along with a keen attention to detail and a strong sense of integrity in handling sensitive information.

Our resume checker is free and needs no account: upload a resume and see what to fix. Check my resume →

View Similar Jobs

Matches Jobs

Similar jobs which you may be interested in. Typically using your existing skillset.