Resume Score
CV/Résumé Score
  • Expertini Resume Scoring: See how well your CV/Résumé matches this job: Data Engineer Scala/Apache Spark.
Expertini

Urgent! Data Engineer - Scala/Apache Spark Job | Ixceed Solutions

Data Engineer Scala/Apache Spark



Job description

<p>Responsibilities :<br/><br/>- Design, develop, and maintain robust and scalable data pipelines using Apache Spark and Scala on the Databricks platform.<br/><br/>- Implement ETL (Extract, Transform, Load) processes for various data sources, ensuring data quality, integrity, and efficiency.<br/><br/>- Optimize Spark applications for performance and cost-efficiency within the Databricks environment.<br/><br/>- Work with Delta Lake for building reliable data lakes and data warehouses, ensuring ACID transactions and data versioning.<br/><br/>- Collaborate with data scientists, analysts, and other engineering teams to understand data requirements and deliver solutions.<br/><br/>- Implement data governance and security best practices within Databricks.<br/><br/>- Troubleshoot and resolve data-related issues, ensuring data availability and reliability.<br/><br/>- Stay updated with the latest advancements in Spark, Scala, Databricks, and related big data technologies.<br/><br/>Required Skills and Experience :<br/><br/>- Proven experience as a Data Engineer with a strong focus on big data technologies.<br/><br/>- Expertise in Scala programming language for data processing and Spark application development.<br/><br/>- In-depth knowledge and hands-on experience with Apache Spark, including Spark SQL, Spark Streaming, and Spark Core.<br/><br/>- Proficiency in using Databricks platform features, including notebooks, jobs, workflows, and Unity Catalog.<br/><br/>- Experience with Delta Lake and its capabilities for building data lakes.<br/><br/>- Strong understanding of data warehousing concepts, data modeling, and relational databases.<br/><br/>- Familiarity with cloud platforms (e.g., AWS, Azure, GCP) and their data services.<br/><br/>- Experience with version control systems like Git.<br/><br/>- Excellent problem-solving and analytical skills.<br/><br/>- Ability to work independently and as part of a team.<br/><br/>Preferred Qualifications (Optional) :<br/><br/>- Experience with other big data technologies like Kafka, Flink, or Hadoop ecosystem components.<br/><br/>- Knowledge of data visualization tools.<br/><br/>- Understanding of DevOps principles and CI/CD pipelines for data engineering.<br/><br/>- Relevant certifications in Spark or Databrick</p> (ref:hirist.tech)


Required Skill Profession

Computer Occupations



Your Complete Job Search Toolkit

✨ Smart • Intelligent • Private • Secure

Start Using Our Tools

Join thousands of professionals who've advanced their careers with our platform

Rate or Report This Job
If you feel this job is inaccurate or spam kindly report to us using below form.
Please Note: This is NOT a job application form.


    Unlock Your Data Engineer Potential: Insight & Career Growth Guide


Advance your career or build your team with Expertini's smart job platform. Connecting professionals and employers in Ahmedabad, India.