データエンジニア/ Data Engineer

A technology company is searching for a Data Engineer. The chosen applicant will be in charge of designing, building, and running a data platform for data ingestion and processing applications. This is a long-term contract and a hybrid role.

Responsibilities:

• Design and implement application architecture
• Promote collaboration between teams
• Validate and improve code quality
• Participate in mid and long-term product vision planning
• Engage in R&D activities for new technologies
• Build and run a data platform for data ingestion and processing applications
• Integrate the latest solutions, including On-Premise/On-Cloud computing resources

Requirements:

• Computer Science or related background
• More than 5 years’ experience in software development, especially using Java/Golang as a programming language
• Experience with microservice architecture like Spring Boot/Spring Cloud
• Experience with RESTful design/Unit Test/Integration Test
• Experience with SQL and some of the modern relational databases
• Experience with caching with Redis/Memcache
• Experience with message queue like RabbitMQ/Kafka
• Experience with CI/CD tools like Jenkins/Spinnaker/Docker
• Experience with throttling/QoS/stress testing/etc.
• Experience with common Linux commands and Linux scripting languages
• Experience with Kubernetes and public cloud environment
• Experience with markup languages
• Familiarity with browser testing and debugging
• In-depth understanding of the entire web development process (design, development, and deployment)
• Preferred Skills:
• Experience with service mesh architecture like Istio
• Experience in web service development in multiple industries
• Experience with front-end development using React
• Experience with developing user-facing web applications and components with React framework
• Experience with building and maintaining data processing pipelines and data platforms
• Solid knowledge of large volume data processing
• Experience with NoSQL databases, such as HBase, MongoDB, CouchBase
• Experience with Airflow, Airflow operators, and DAGs
• Experience with Kubernetes, Cloud Native technologies
• Experience with log aggregation systems like ELK/Flume
• Experience with Hadoop, MapReduce, HDFS, and Big Data querying tools such as Tez, Hive, and Impala
• Experience with LLM-based app development

About the Company:

A renowned technology company offering a wide range of services spanning e-commerce, fintech, digital content, and more. With a commitment to innovation and customer-centric solutions, the organisation continues to expand its ecosystem, empowering businesses and consumers alike.

Keywords:

データエンジニアリング, IT, テクニカル, テクノロジー, eコマース

Job Ref: Z6GD34