Date Posted:
Salary:
id
Apply Now Whatsapp to Friend Save This Job

Job Description

Overseeing the collection, storage, management, quality, and protection of data.

Gather and process raw data at scale (including writing scripts, web scraping, calling APIs, writing SQL queries, etc.)

Engineering costs optimization

Lead, motivate, and manage data engineers teams.

Effectively communicate the status, value, and importance of data collection to executive members and staff.

Target: - Client data monitoring and notifications

  • Crawler stability > 90%
  • Mean time to repair crawler incident
Min 4 years programming experience in python, NodeJs and PHP

Min 2 years experience for web crawling and data cleaning

Min 2 years experience in queuing and message broker (Kafka, RabbitMQ, Google Cloud Pub/Sub, NATS). min. 1 platform.

Min 2 years experience with the UNIX environment.

Min 1 year experience in GCP Product like Bigquery, Dataflow, PubSub, GCS

Min 1 year experience in protecting web scrapers against site ban, IP leak, browser crash, CAPTCHA and proxy failure.

Min 1+ years experience with container technology (Kubernetes, Docker)

Bachelor's degree in information technology or related fields

Related Jobs

  • Corporate Legal

    - Posted30+ hari yang lalu
    Apply Now

    Membuat dan menyiapkan kontrak, memeriksa dan memodifikasi dokumen legal & perusahaan. Memeriksa dan memberikan saran legal dalam seluruh dokumen.

  • -
    Apply Now

  • Customer Support Officer

    - Posted30+ hari yang lalu
    Apply Now

    Serve customers by telephone, face to face and email. Maintain the confidentiality customer privacy including complaints or requests from customers.

  • Mobile Developer

    - Posted30+ hari yang lalu
    Apply Now

    Integrate back-end or third-party API's. Collaborate with cross-functional teams to define, design, and build the mobile application for Android and iOS…

  • Head of Project Management Office

    Ericsson
    - 9 hari yang lalu
    Apply Now

    Build a productive work environment for individuals and own organization as well as run performance management (process) and competence management.

Job Detail

  • Job Id
    13507e7f503233df
  • Location
    id
  • Company
  • Type
    Private
  • Employment Status
    Permanent
  • Positions
    Available
  • Career Level
    Experience
  • Gender
    Male/Female

Contact

Sponsored by

https://www.halokerja.id connects jobseekers and recruiters by accurately matching candidate profiles to the relevant job openings through an advanced 2-way matching technology. While most job portals only focus on getting candidates the next job, Shine focuses on the entire career growth of candidates.

Quick Links
Jobs By Industry
Latest Job
Copyright © 2026 halokerja.id . All Rights Reserved.