Skip to content

Conversation

@atzoum
Copy link
Contributor

@atzoum atzoum commented Nov 14, 2025

Description

JobsDB tables now have a new column, partition_id.
This column will be indexed and populated in the following JobsDB instances:

  • gw
  • rt
  • batch_rt

The value for partition_id is computed as {{workspaceID}}-{{murmur3Hash32Index(userID)}}, meaning:

  • The first part comes from the job’s WorkspaceID
  • The second part is the partition index derived from the job’s UserID

Note: Existing jobs in the database will have an empty partition_id. This is acceptable, as the column will not be actively used for some time.

Linear Ticket

Resolves PIPE-2557
Resolves PIPE-2559

Security

  • The code changed/added as part of this pull request won't create any security issues with how the software is being used.

@atzoum atzoum force-pushed the feat.jobsdbPartitionIdColumn branch from a5f3d04 to 833b929 Compare November 14, 2025 11:16
@atzoum atzoum changed the title Feat.jobsdb partition id column feat(jobsdb): partition id column Nov 17, 2025
@atzoum atzoum force-pushed the feat.jobsdbPartitionIdColumn branch 2 times, most recently from 6cb409e to 6693b50 Compare November 17, 2025 10:00
@codecov
Copy link

codecov bot commented Nov 17, 2025

Codecov Report

❌ Patch coverage is 87.50000% with 7 lines in your changes missing coverage. Please review.
✅ Project coverage is 79.30%. Comparing base (56dc15e) to head (af40a64).

Files with missing lines Patch % Lines
jobsdb/jobsdb.go 88.37% 3 Missing and 2 partials ⚠️
app/apphandlers/processorAppHandler.go 0.00% 2 Missing ⚠️
Additional details and impacted files
@@            Coverage Diff             @@
##           master    #6502      +/-   ##
==========================================
- Coverage   79.41%   79.30%   -0.11%     
==========================================
  Files         531      531              
  Lines       59739    59786      +47     
==========================================
- Hits        47439    47412      -27     
- Misses       9455     9536      +81     
+ Partials     2845     2838       -7     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@atzoum atzoum force-pushed the feat.jobsdbPartitionIdColumn branch from 6693b50 to 7b114ab Compare November 17, 2025 10:58
@atzoum atzoum changed the title feat(jobsdb): partition id column feat(jobsdb): introduce partition_id column Nov 17, 2025
@atzoum atzoum force-pushed the feat.jobsdbPartitionIdColumn branch 3 times, most recently from c2f7cdc to 1f7c251 Compare November 18, 2025 08:39
@atzoum atzoum marked this pull request as ready for review November 18, 2025 10:13
@atzoum atzoum force-pushed the feat.jobsdbPartitionIdColumn branch 3 times, most recently from 5a1ec68 to af40a64 Compare November 19, 2025 14:58
🔒 Scanned for secrets using gitleaks 8.28.0
@atzoum atzoum force-pushed the feat.jobsdbPartitionIdColumn branch from af40a64 to 1a3b4df Compare November 19, 2025 15:52
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants