Date Posted:
Salary:
id
Apply Now Whatsapp to Friend Save This Job

Job Description

Overseeing the collection, storage, management, quality, and protection of data.

Gather and process raw data at scale (including writing scripts, web scraping, calling APIs, writing SQL queries, etc.)

Engineering costs optimization

Lead, motivate, and manage data engineers teams.

Effectively communicate the status, value, and importance of data collection to executive members and staff.

Target: - Client data monitoring and notifications

  • Crawler stability > 90%
  • Mean time to repair crawler incident
Min 4 years programming experience in python, NodeJs and PHP

Min 2 years experience for web crawling and data cleaning

Min 2 years experience in queuing and message broker (Kafka, RabbitMQ, Google Cloud Pub/Sub, NATS). min. 1 platform.

Min 2 years experience with the UNIX environment.

Min 1 year experience in GCP Product like Bigquery, Dataflow, PubSub, GCS

Min 1 year experience in protecting web scrapers against site ban, IP leak, browser crash, CAPTCHA and proxy failure.

Min 1+ years experience with container technology (Kubernetes, Docker)

Bachelor's degree in information technology or related fields

Related Jobs

  • GRAPHIC DESIGNER INTERN

    - 25 hari yang lalu
    Apply Now

    As a Designer Intern at Lamudi, you will get the best hands-on learning to prepare you for your first full-time job.

  • Project Manager for Banking Application

    - Posted30+ hari yang lalu
    Apply Now

    Working as project manager in various types of IT project, from service and product development to large scale system integration as part of the group in…

  • Baru Agency Team Builders Lead

    Manulife
    - 1 hari yang lalu
    Apply Now

    Lead and supervise the performance of the team in doing projects for processes improvement so that projects can be completed on time with results as expected.

  • Brand Strategist

    - Posted30+ hari yang lalu
    Apply Now

    Conduct brand audit and competitor analysis & turning data into actionable insights. This position will develop campaigns that increase brand awareness and…

  • -
    Apply Now

Job Detail

  • Job Id
    13507e7f503233df
  • Location
    id
  • Company
  • Type
    Private
  • Employment Status
    Permanent
  • Positions
    Available
  • Career Level
    Experience
  • Gender
    Male/Female

Contact

Sponsored by

https://www.halokerja.id connects jobseekers and recruiters by accurately matching candidate profiles to the relevant job openings through an advanced 2-way matching technology. While most job portals only focus on getting candidates the next job, Shine focuses on the entire career growth of candidates.

Quick Links
Jobs By Industry
Latest Job
Copyright © 2026 halokerja.id . All Rights Reserved.