• Sources: primary
  • Summary: Each field in a Freight Search index comes from exactly one fragment, which declares its source and mapping. A Spark job bootstraps every source and merges fragments per UUID into OpenSearch, and a Flink job applies CDC events from the bootstrap offset. More than 70 topics feed 300 fragments in over 20 indices, serving thousands of QPS at hundreds of milliseconds p99.
  • Why it matters: Single ownership per field is a concrete way to let many teams feed one denormalized index without coordinating rebuilds.