Data Engineer

About the role

We’re hiring a data engineer to build the ingestion and search systems behind Solve Intelligence’s AI products. You will own end‑to‑end pipelines that turn global patent literature, case law, standards and scientific data into searchable, high‑performance datasets.

Key responsibilities

• Build and operate high‑throughput, resumable ingestion pipelines for large, messy datasets with incremental updates and failure recovery.
• Extract and validate content from complex documents, handling malformed records and evolving schemas.
• Design and implement keyword, vector and structured search, including schema, indexing and partitioning for fast queries over tens to hundreds of millions of records.
• Link patents, scientific records and supporting documents, preserving provenance and versioning.
• Profile and tune parsing, ingestion, database builds and query performance to optimise latency, throughput and cost.

Required profile

• Strong Python and SQL skills with experience designing and operating production databases.
• Proven experience building and operating production data pipelines over large, messy datasets.
• Experience running search systems over large document collections and end‑to‑end ownership from raw data to user‑facing functionality.

Required skills

• Python
• SQL
• PostgreSQL
• pgvector
• OpenSearch
• Elasticsearch
• Spark
• Delta Lake
• AWS
• NoSQL databases
• Rust
• C++

What we offer

• Competitive salary plus significant equity.
• Full visa sponsorship and private medical insurance.
• Free meals and a seat at the table with a smart, ambitious team.