AI Developer - Web Scraper Agent Using Claude on AWS Job at BlueClerk, Austin, TX

Z1I5elJ4eUJrNXZIMHh2Y3NVWmZmT0VZRXc9PQ==
  • BlueClerk
  • Austin, TX

Job Description

Freelance / Remote

Hourly (via Hubstaff)

We are seeking a skilled AI Developer with experience using Anthropic’s Claude models and AWS infrastructure to build a web scraper AI agent. The goal of this project is to create an intelligent agent that can autonomously search the web for **home builders and their subdivisions**, extract relevant data, and insert it into our existing **MongoDB** database.

* Build and deploy an AI agent using **Claude on AWS** (SageMaker, Bedrock, or other relevant tools).
* Design prompts and logic to guide the agent to locate home builders and their active/past subdivisions from public websites.
* Scrape relevant structured and unstructured data (e.g., builder name, subdivision names, states, URLs, etc.).
* Clean, structure, and inject the scraped data directly into our **MongoDB** database.
* Set up and test recurring scraping logic with minimal human supervision.
* Build in error handling, logging, and rate-limiting protection.
* Work closely with our team to adapt the agent based on results and needed improvements.
* Proven experience with **AI models**, especially **Claude by Anthropic**, and **prompt engineering**.
* Strong AWS knowledge, ideally with experience in **SageMaker**, **Lambda**, **EventBridge**, or **Bedrock**.
* Solid experience in **Python**, **web scraping (e.g., BeautifulSoup, Scrapy, Playwright)**, and **MongoDB integration**.
* Understanding of how to make scrapers mimic human behavior to avoid IP bans.
* Ability to work autonomously and deliver results fast.
* Clear written communication and daily check-ins via Hubstaff.
* Experience with **data deduplication and validation**.
* Familiarity with housing and construction industry websites (e.g., DR Horton, Lennar, etc.).
* Ability to recommend improvements in how the data is structured or stored.

Please include examples of previous scraping agents or AI automation tools you've built. Preference will be given to those with **Claude + AWS** experience. Shortlisted candidates may be asked to complete a brief test task. Please note pay is up to $15/hour, based on experience.

Job Tags

Hourly pay, Contract work, Freelance, Remote job,

Similar Jobs

Detroit Medical Center

Registered Nurse (RN) - Manager, Pediatrics OR - Operating Room - $31-43 per hour Job at Detroit Medical Center

 ...Detroit Medical Center is seeking a Registered Nurse (RN) Manager, Pediatrics OR - Operating Room for a nursing job in Detroit, Michigan. Job Description & Requirements ~ Specialty: Pediatrics OR - Operating Room ~ Discipline: RN ~ Duration: Ongoing ~36... 

The Cigna Group

Pharmacy Technician - Freedom Fertility - Remote, AZ Job at The Cigna Group

This is a full-time work from home position that must reside **within the state of** **Arizona...  ...patients in receiving needed medications to help achieve their dreams of building...  ...required.+ Microsoft Office proficiency and data entry skills+ Basic math skills (addition/... 

NP Now

Internal Medicine Physician - $325000.00 Job at NP Now

 ...A thriving healthcare system is seeking an Internal Medicine Physician to work in the Fall River, MA area!Live in Barrington, RI - Sharon,...  ...specialty care, and full diagnostic services (MRI, CT scans, nuclear cardiac testing, vascular testing, ultrasound, x-rays, etc.)... 

Litton Resource Group

Physician Assistant-Psychiatry Job at Litton Resource Group

 ...Summary We are seeking a Physician Assistant to join our clinic in the Sacramento area. We are expanding and need Providers to join our outpatient practice. We treat children and adults and we employ the full Psychiatric interdisciplinary tea Job Responsibilities... 

Warner Media, LLC.

VP, Business & Media - CNN (Washington) Job at Warner Media, LLC.

 ...benefits, and the tools to explore and grow into your best selves. Here you are supported, here you are celebrated, here you can thrive. CNNs Vice President of Business & Media is pivotal in defining and executing CNNs strategy to deliver distinctive, deeply reported...