Replies: 1 comment
-
|
here another one first run: $ litestream replicate ./db/database.sqlite3 gs://ricum-db/litestream
time=2025-11-23T23:07:46.772+02:00 level=INFO msg=litestream version=0.5.2 level=""
time=2025-11-23T23:07:46.773+02:00 level=INFO msg="replicating to" type=gs sync-interval=1s bucket=ricum-db path=litestream
time=2025-11-23T22:08:26.920+02:00 level=ERROR msg="compaction failed" level=9 error="page size not initialized yet"
time=2025-11-23T22:08:30.351+02:00 level=INFO msg="compaction complete" level=1 txid.min=0000000000000001 txid.max=0000000000000001 size=229079
time=2025-11-23T22:10:06.713+02:00 level=ERROR msg="compaction failed" level=2 error="write ltx file: extract timestamp from LTX header: EOF"
time=2025-11-23T22:13:02.473+02:00 level=INFO msg="compaction complete" level=1 txid.min=0000000000000002 txid.max=0000000000000002 size=1633
time=2025-11-23T22:13:32.421+02:00 level=INFO msg="compaction complete" level=1 txid.min=0000000000000003 txid.max=0000000000000003 size=1638
time=2025-11-23T22:14:02.391+02:00 level=INFO msg="compaction complete" level=1 txid.min=0000000000000004 txid.max=0000000000000004 size=1627
time=2025-11-23T22:15:22.008+02:00 level=ERROR msg="compaction failed" level=2 error="write ltx file: extract timestamp from LTX header: EOF"
time=2025-11-23T22:20:02.433+02:00 level=INFO msg="compaction complete" level=1 txid.min=0000000000000005 txid.max=0000000000000005 size=685
time=2025-11-23T22:20:19.700+02:00 level=ERROR msg="compaction failed" level=2 error="write ltx file: extract timestamp from LTX header: EOF"
time=2025-11-23T22:20:32.485+02:00 level=INFO msg="compaction complete" level=1 txid.min=0000000000000006 txid.max=0000000000000006 size=2070
time=2025-11-23T22:21:02.403+02:00 level=INFO msg="compaction complete" level=1 txid.min=0000000000000007 txid.max=0000000000000007 size=1614
time=2025-11-23T22:22:32.361+02:00 level=INFO msg="compaction complete" level=1 txid.min=0000000000000008 txid.max=0000000000000008 size=1592
time=2025-11-23T22:23:02.304+02:00 level=INFO msg="compaction complete" level=1 txid.min=0000000000000009 txid.max=0000000000000009 size=1638
time=2025-11-23T22:24:32.442+02:00 level=INFO msg="compaction complete" level=1 txid.min=000000000000000a txid.max=000000000000000a size=1694
time=2025-11-23T22:25:02.331+02:00 level=INFO msg="compaction complete" level=1 txid.min=000000000000000b txid.max=000000000000000b size=1736
time=2025-11-23T22:25:19.646+02:00 level=ERROR msg="compaction failed" level=2 error="write ltx file: extract timestamp from LTX header: EOF"
time=2025-11-23T22:30:22.163+02:00 level=ERROR msg="compaction failed" level=2 error="write ltx file: extract timestamp from LTX header: EOF"
time=2025-11-23T22:35:19.941+02:00 level=ERROR msg="compaction failed" level=2 error="write ltx file: extract timestamp from LTX header: EOF"2nd run: $ litestream replicate ./db/database.sqlite3 gs://ricum-db/litestream
time=2025-11-23T23:07:46.772+02:00 level=INFO msg=litestream version=0.5.2 level=""
time=2025-11-23T23:07:46.773+02:00 level=INFO msg="replicating to" type=gs sync-interval=1s bucket=ricum-db path=litestream
time=2025-11-23T23:07:47.088+02:00 level=ERROR msg="compaction failed" level=9 error="page size not initialized yet"
time=2025-11-23T23:07:47.214+02:00 level=ERROR msg="compaction failed" level=2 error="write ltx file: extract timestamp from LTX header: EOF"
time=2025-11-23T23:07:47.954+02:00 level=INFO msg="detected database behind replica" db=database.sqlite3 db_txid=0000000000000000 replica_txid=0000000000000018
time=2025-11-23T23:07:48.036+02:00 level=INFO msg="fetched latest L0 file from replica" db=database.sqlite3 min_txid=0000000000000018 max_txid=0000000000000018
time=2025-11-23T23:07:48.044+02:00 level=ERROR msg="sync error" db=database.sqlite3 error="cannot verify wal state: pos: ltx verification failed: decode header: EOF"
time=2025-11-23T23:07:48.078+02:00 level=ERROR msg="monitor error" db=database.sqlite3 replica=gs error="cannot determine current position: ltx verification failed: decode header: EOF"
time=2025-11-23T23:07:48.780+02:00 level=ERROR msg="sync error" db=database.sqlite3 error="cannot verify wal state: pos: ltx verification failed: decode header: EOF"
time=2025-11-23T23:07:51.975+02:00 level=ERROR msg="sync error" db=database.sqlite3 error="cannot verify wal state: pos: ltx verification failed: decode header: EOF"
time=2025-11-23T23:07:52.970+02:00 level=ERROR msg="sync error" db=database.sqlite3 error="cannot verify wal state: pos: ltx verification failed: decode header: EOF"
time=2025-11-23T23:07:53.985+02:00 level=ERROR msg="sync error" db=database.sqlite3 error="cannot verify wal state: pos: ltx verification failed: decode header: EOF"restore from bucket: $ litestream restore -o ./db/database.sqlite3 gs://ricum-db/litestream
time=2025-11-23T23:09:46.438+02:00 level=ERROR msg="failed to run" error="decode database: decode header: EOF"
$ litestream ltx gs://ricum-db/litestream
min_txid max_txid size created
0000000000000018 0000000000000018 20062 2025-11-23T20:54:54Zdownloading the same ltx from bucket and running restore from file works |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
-
This is from cloud run but I think I had issues replicating to existing logs on local setup as well.
Maybe after replicating to gs bucket, downloading ltx from the bucket, restoring the db from ltx, and then start replication from the resulting db to its existing logs. Basically, same sequence as in cloud run. You get cannot verify wal state: pos: ltx verification failed: decode header: EOF.
First run, no replica:
time=2025-11-15T19:22:07.640Z level=INFO msg=litestream version=0.5.2 level=""
time=2025-11-15T19:22:08.179Z level=ERROR msg="compaction failed" level=9 error="page size not initialized yet"
time=2025-11-15T19:22:30.179Z level=INFO msg="compaction complete" level=1 txid.min=0000000000000001 txid.max=0000000000000001 size=239239
time=2025-11-15T19:23:01.013Z level=INFO msg="compaction complete" level=1 txid.min=0000000000000002 txid.max=0000000000000002 size=24700
time=2025-11-15T19:23:31.367Z level=INFO msg="compaction complete" level=1 txid.min=0000000000000003 txid.max=0000000000000003 size=1669
time=2025-11-15T19:24:03.306Z level=INFO msg="compaction complete" level=1 txid.min=0000000000000004 txid.max=0000000000000004 size=1670
time=2025-11-15T19:24:31.982Z level=INFO msg="compaction complete" level=1 txid.min=0000000000000005 txid.max=0000000000000005 size=1671
time=2025-11-15T19:25:00.267Z level=ERROR msg="compaction failed" level=2 error="write ltx file: extract timestamp from LTX header: EOF"
time=2025-11-15T19:25:01.121Z level=INFO msg="compaction complete" level=1 txid.min=0000000000000006 txid.max=0000000000000006 size=1638
...
2nd run:
time=2025-11-15T20:01:27.017Z level=INFO msg=litestream version=0.5.2 level=""
time=2025-11-15T20:01:27.274Z level=ERROR msg="compaction failed" level=9 error="page size not initialized yet"
time=2025-11-15T20:01:27.462Z level=ERROR msg="compaction failed" level=2 error="write ltx file: extract timestamp from LTX header: EOF"
time=2025-11-15T20:01:28.043Z level=INFO msg="detected database behind replica" db=database.sqlite3 db_txid=0000000000000000 replica_txid=000000000000000a
time=2025-11-15T20:01:28.060Z level=INFO msg="fetched latest L0 file from replica" db=database.sqlite3 min_txid=000000000000000a max_txid=000000000000000a
time=2025-11-15T20:01:28.060Z level=ERROR msg="sync error" db=database.sqlite3 error="cannot verify wal state: pos: ltx verification failed: decode header: EOF"
time=2025-11-15T20:01:28.076Z level=ERROR msg="monitor error" db=database.sqlite3 replica=gs error="cannot determine current position: ltx verification failed: decode header: EOF"
time=2025-11-15T20:01:29.017Z level=ERROR msg="sync error" db=database.sqlite3 error="cannot verify wal state: pos: ltx verification failed: decode header: EOF"
time=2025-11-15T20:01:30.043Z level=ERROR msg="sync error" db=database.sqlite3 error="cannot verify wal state: pos: ltx verification failed: decode header: EOF"
and so on...
Beta Was this translation helpful? Give feedback.
All reactions