Open Data

Job type Permanent
Salary 9000000
Reference 57169

Data Engineer – Cloud Data Platform

Employment Type

Full-time (Permanent)

Location

Tokyo / Nagoya / Osaka, Japan
(Primarily office-based; remote flexibility varies by team)

Salary

Approx. JPY 5.5M – 9.3M annually (negotiable based on experience)
Annual bonus and yearly salary review included

About the Company

A publicly listed Japanese SaaS company specializing in cloud security solutions is expanding its Data Platform team.

As organizations increasingly adopt SaaS and cloud services, security, access control, and operational complexity have become critical concerns. The company provides a subscription-based cloud security platform widely adopted by enterprise clients across Japan, maintaining an exceptionally low churn rate compared to industry standards.

With rapid growth in service adoption and data volume, the organization is investing in strengthening its large-scale data infrastructure to support future expansion.

Position Overview

As cloud service usage grows, user activity logs and service data are increasing significantly. Efficient, scalable, and secure data management is essential to continued product innovation and business growth.

This role is designed for a Data Engineer who goes beyond system maintenance — someone who can architect, operate, and continuously improve a cloud-based data platform that directly supports business strategy and decision-making.

Key Responsibilities

  • Design, build, and maintain large-scale data management platforms on AWS.

  • Develop and optimize ETL pipelines and data workflows.

  • Improve performance and cost efficiency of AWS infrastructure and databases.

  • Manage data governance policies and access controls.

  • Operate and maintain BI tools and analytics environments.

  • Enable secure, scalable environments for efficient data analysis across the organization.

Core Duties

  • Design and operate data platforms handling high-volume user log data.

  • Develop ETL processes using Python and SQL.

  • Perform data cleansing, transformation, and modeling.

  • Collaborate with business teams to define data requirements and analytical structures.

  • Optimize AWS-based databases and data pipelines.

Example Initiatives

  • Designing aggregation frameworks to evaluate new product features or service enhancements.

  • Partnering with business leaders to analyze customer usage data and support sales or strategic planning decisions.

Collaboration

You will work cross-functionally with:

  • Product Management

  • Sales

  • Marketing

  • Customer Success

Your role will empower these teams by providing reliable, secure, and accessible data for decision-making.

Scope & Ownership

  • Ownership of the company’s core data platform architecture.

  • High autonomy in designing ETL workflows and improving system design.

  • Authority to recommend and implement AWS optimization strategies.

  • Opportunity to shape future data utilization strategies and accelerate business growth.

Team Environment

  • Total team size: Approximately 10 members

  • Data Engineering team: Small, specialized group

  • Culture emphasizes ownership, autonomy, and execution of ideas

What You’ll Gain

  • Experience handling large-scale production data environments.

  • Advanced AWS cloud development exposure (e.g., EC2, Lambda, API services, RDS, S3, etc.).

  • End-to-end system development experience from requirements gathering through deployment.

  • Cross-functional exposure, strengthening both technical and business expertise.

  • Experience building secure, enterprise-grade data platforms.

Required Qualifications

  • 3+ years of experience designing and operating AWS-based systems (e.g., S3, RDS, Redshift, Glue).

  • 3+ years of hands-on experience in data engineering or ETL development.

  • Proficiency in Python and SQL.

  • Experience with API integrations.

  • Experience with tools such as PySpark and/or dbt.

  • Knowledge of data governance and data mart design principles.

  • Basic understanding of IT infrastructure (hardware, software, networking).

  • Experience using Git or similar version control systems.

  • Basic Linux operational skills.

  • Experience in requirement definition and system specification documentation.

  • Business-level Japanese proficiency.

  • Ability to work in English or willingness to improve English communication skills.

Preferred Qualifications

  • TOEIC 600+ or equivalent English proficiency.

  • Familiarity with container technologies (e.g., Docker).

  • Basic understanding of security concepts.

  • AWS certifications (e.g., Solutions Architect, SysOps Administrator).

Ideal Candidate

  • Self-motivated, honest, and positive mindset.

  • Takes ownership and proactively solves problems.

  • Results-oriented and capable of selecting optimal solutions independently.

  • Flexible and open to new challenges.

  • Curious about emerging technologies and industry trends.