Data Engineer - English only Ok!

求人詳細

【Responsibilities/ 担当業務】
- Plan, design and maintain scalable and reliable data pipelines and data integration processes
- Build, maintain, and scale the data platform using large-scale data processing frameworks and tools such as Spark, Scala, and Kafka
- Drive the adoption of best practices in data engineering, data management, and data governance.
- Stay updated with emerging technologies and trends in the field of data engineering and assess their adoption.
- Enable senior management to take strategic decisions by providing insights and recommendations based on data.
- Collaborate with stakeholders to define and drive the overall data initiative, strategy and roadmap.
- Ensure that data assets are managed and used effectively.
- Drive data integrity, quality, and facilitate data sharing while ensuring/following regulatory compliance.

Additional Information
- Debug and maintain applications on production with the use of logging, alerting and monitoring tools
- Collaborate with other teams and cross-team members effectively
- Participate in prototyping exercises with new technologies or competing third party solutions and be able to deliver PoCs

Good to have :
- Experience with Docker, Kubernetes
- Experience with real-time/streaming data pipelines

こんな方を求めています

経験・スキル

Mandatory Skills：
- Strong understanding in data engineering, including designing and building data pipelines and data integration solutions.
- Strong understanding of SQL and NoSQL databases, data warehousing concepts, and data modeling techniques.
- Strong understanding of bigdata/large-scale processing frameworks such as Spark, Kafka, Hadoop
- Strong programming experience using Scala/Java/Python
- Experience with scheduling tools such as Airflow, Azkaban, Systemwalker, Oozie
- Experience with working on public cloud solutions (GCP preferred)
- Excellent problem-solving and analytical skills
- Strong communication and collaboration skills
- Ability to work independently and as part of a team

学歴

大学卒業以上

募集要項

職種

データサイエンティスト

給与

年収 600 〜 900万円

賞与

0

雇用形態

契約社員

雇用期間

期間の定めなし

試用期間

無し

就業時間

09:00～17:30

休日休暇

土曜日　日曜日　祝日

保険

健康保険　厚生年金保険　雇用保険

受動喫煙防止措置

敷地内禁煙

業種

ソフトウェア・情報処理

※詳細はお仕事のご紹介時にお伝えします