Data Engineer (Databricks) - Global Insurance Firm (Randstad Contract)

求人詳細

Randstad is partnered with global Life Insurance client in their search for a Data Engineer. Through this role you will join the firm's global Data Management department, where you will work alongside brilliant data professionals as they embark in a journey to adopt Databricks. If you have strong background in Data Engineering with Scala and Spark and expertise in Databricks, this role is for you.

Responsibilities
- Analyze business requirements, create proper data solutions that meets functional and non-functional requirements.
- Define the data architecture, structure, storage, and security model for migrating data processing from Azure Synapse Analytics to Azure Databricks, Azure Data Lake Storage (ADLS), Azure Cosmos DB, and RestAPI.
- Design and implement highly scalable data pipelines in Scala/Python/Java with Spark for processing of extreme large amount of data.
- Create and maintain reusable frameworks for data ingestion, validation, normalization, and transformation.
- Automate Unit testing and release with CI/CD pipeline.
- Create scripts for operations, releases, data migrations, data validations.
- Maintain data lineage information
- Provide technical support for releases, issues, and incidents

こんな方を求めています

経験・スキル

Experience:
- Minimum 6 years of working experience as developer or data engineer
- Strong hands-on experience with Azure Databricks and migrating legacy data platforms/Azure Synapse Analytics workloads to Azure Databricks, alongside Azure Data Lake Storage (ADLS) and Azure Data Factory

Skills:
- Strong programming skills in Scala/Python/Java, Apache Spark optimization, and Delta Lake
- Strong capabilities in designing Database schemas on data platform
- Good knowledge of Oracle database, MS-SQL Server, MongoDB, Kerberos, Linux, networking
- Proficient in SQL, shell scripting, git, unit testing, CI/CD tools
- Understanding of design principles, coding standards and best practices
- Excellent problem-solving skills
- Excellent data analytics skills
- Excellent communication, presentation, and interpersonal skills

Preferable:
- Understanding of REST API, micro-services, and ETL.
- Hands-on experience with Azure Cloud services is preferred
- Understanding of streaming data processing and change data capture is preferred

学歴

大学卒業以上

募集要項

職種

システム開発（組み込み・ファームウェア・制御系）

給与

年収 700 〜 1,000万円

賞与

-

雇用形態

契約社員

雇用期間

期間の定めなし

就業時間

09:00～18:00

休日休暇

土曜日　日曜日　祝日

保険

健康保険　厚生年金保険　雇用保険

受動喫煙防止措置

敷地内禁煙

業種

保険

※詳細はお仕事のご紹介時にお伝えします

更新日：2026/09/18