Kirill Bulatov
b683308791
Return GIT_VERSION back to storage binaries
2022-05-13 16:34:32 +03:00
Kirill Bulatov
51c0f9ab2b
Force git version to be up to date via decl macro
2022-05-13 16:34:32 +03:00
Stas Kelvich
0030da57a8
compute-tools: grant rw priveleges to the all created users
2022-05-13 11:27:00 +03:00
Kirill Bulatov
85884a1599
Disable tenant relocation python test
2022-05-13 01:26:38 +03:00
Thang Pham
ae20751724
update ZenithCli::create_tenant return signature ( #1692 )
...
to include the initial timeline's ID in addition to the new tenant's ID.
Context: follow-up of https://github.com/neondatabase/neon/pull/1689
2022-05-12 17:27:08 -04:00
Thang Pham
5812e26b90
Create an initial timeline on CLI tenant creation ( #1689 )
...
Resolves #1655
2022-05-12 16:33:09 -04:00
Arthur Petukhovsky
ec8861b8cc
Fix pageserver metrics names ( #1682 )
...
Try to follow Prometheus style-guide https://prometheus.io/docs/practices/naming/ for metrics names. More specifically:
- Use `pageserver_` prefix for all pagserver metrics
- Specify `_seconds` unit in time metrics
- Use unit as a suffix in other cases, such as `_hits`, `_bytes`, `_records`
- Use `_total` suffix for accumulating counters (note that Histograms append that suffix internally)
2022-05-12 19:53:07 +03:00
Kirill Bulatov
4538f1e1b8
Correctly operate etcd safekeeper timeline data
2022-05-12 18:47:31 +03:00
Stas Kelvich
b10ae195b7
Set vendor/postgres back to the main branch
...
I accidentally merged postgres PR that was referencing non-main branch.
2022-05-12 15:05:49 +03:00
Alexey Kondratov
b426775aa0
Use compute-tools from the new neondatabase Docker Hub repo
2022-05-12 12:26:24 +03:00
Heikki Linnakangas
5da4f3a4df
Refactor DeltaLayer::dump() function
...
Put most of the code in a closure that returns Result, so that we can
use the ?-operator for error handling. That's simpler.
2022-05-12 10:31:04 +03:00
Konstantin Knizhnik
2bde77fced
Do not apply records with LSN smaller than LSN of cached image in del… ( #1672 )
...
* Do not apply records with LSN smaller than LSN of cached image in delta layer
* Do not apply records with LSN smaller than LSN of cached image in delta layer
2022-05-12 07:56:02 +03:00
Dhammika Pathirana
c864091035
Fix err msg typo
...
Signed-off-by: Dhammika Pathirana <dham@neon.tech >
2022-05-11 16:13:26 -07:00
Anton Shyrabokau
20361395bb
Add zenith-us-stage-sk-5 to circleci inventory ( #1665 )
...
Co-authored-by: Debian <admin@ip-10-0-5-32.us-west-2.compute.internal >
2022-05-11 21:36:53 +03:00
Arseny Sher
b338b5dffe
Make callmemaybe less agressive until we fix it/migrate to bigger machines.
2022-05-11 22:16:13 +04:00
Stas Kelvich
5bd879f641
Proxy: update protocol after cluster->project rename
2022-05-11 15:50:36 +03:00
Konstantin Knizhnik
e6e883eb12
Do not set LSN for new FPI page ( #1657 )
...
* Do not set LSN for new FPI page
refer #1656
* Add page_is_new, page_get_lsn, page_set_lsn functions
* Fix page_is_new implementation
* Add comment from XLogReadBufferForRedoExtended
2022-05-11 15:23:17 +03:00
Heikki Linnakangas
d710dff975
Remove unnecessary Serialize/Deserialize traits from VecMap.
...
It's never stored on disk. Let's be tidy.
2022-05-10 23:47:40 +03:00
Arseny Sher
6cb14b4200
Optionally remove WAL on safekeepers without s3 offloading.
...
And do that on staging, until offloading is merged.
2022-05-10 22:41:02 +04:00
Thang Pham
87dfa99734
Update layered_repository REAMDE ( #1659 )
2022-05-10 09:55:14 -04:00
Thang Pham
cf59b51519
Update README (Running local installation section) ( #1649 )
2022-05-09 11:11:46 -04:00
Kirill Bulatov
0a7735a656
Rework remote storage sync queue, general refactoring
2022-05-07 01:33:33 +03:00
Kirill Bulatov
64a602b8f3
Delete timeline layers
2022-05-07 01:33:33 +03:00
Kirill Bulatov
10e4da3997
Rework timeline batching
2022-05-07 01:33:33 +03:00
Kirill Bulatov
de37f982db
Share the remote storage as a crate
2022-05-07 00:30:36 +03:00
Kirill Bulatov
d4e155aaa3
Librarify common etcd timeline logic
2022-05-06 22:32:57 +03:00
Arseny Sher
dd6dca9072
Bump vendor/postgres to shut down on wrong basebackup.
2022-05-06 20:07:26 +04:00
bojanserafimov
ef40e404cf
Rename zenith crate to neon_local ( #1625 )
2022-05-05 19:06:53 -04:00
Sergey Melnikov
11a44eda0e
Add TLS support in scram-proxy ( #1643 )
...
* Add TLS support in scram-proxy
* Fix authEndpoint
2022-05-05 23:48:16 +03:00
Heikki Linnakangas
30a7598172
Some copy-editing.
2022-05-05 22:35:15 +03:00
Heikki Linnakangas
1ad5658d9c
Fix typos
2022-05-05 22:35:15 +03:00
Dmitry Rodionov
954859f6c5
add readme for performance tests with the current state of things
2022-05-05 22:35:15 +03:00
Andrey Taranik
4024bfe736
get_binaries script fix ( #1638 )
...
* get_binaries script fix
* minor improvment for get_binaries
2022-05-05 22:21:07 +03:00
Kirill Bulatov
2ef0e5c6ed
Do not require metadata in every upload sync task
2022-05-05 18:26:39 +03:00
Kirill Bulatov
52a7e3155e
Add local path to the Layer trait and historic layers
2022-05-05 18:26:39 +03:00
Thang Pham
ad5eaa6027
Use node's LSN for read-only nodes ( #1642 )
...
Fixes #1410 .
2022-05-05 10:53:10 -04:00
Dmitry Rodionov
0f3ec83172
avoid detach with alive branches
2022-05-05 12:54:42 +03:00
Arseny Sher
c46fe90010
Fix division by zero in WAL removal.
2022-05-05 10:41:43 +04:00
bojanserafimov
bc569dde51
Remove some unwraps from waldecoder ( #1539 )
2022-05-04 17:41:05 -04:00
bojanserafimov
02e5083695
Add hot page test ( #1479 )
2022-05-04 12:45:01 -04:00
Thang Pham
c4bc604e5f
Fix pg list table alignment #1633
...
Fixes #1628
- add [`comfy_table`](https://github.com/Nukesor/comfy-table/tree/main ) and use it to construct table for `pg list` CLI command
Comparison
- Old:
```
NODE ADDRESS TIMELINE BRANCH NAME LSN STATUS
main 127.0.0.1:55432 3823dd05e35d71f6ccf33049de366d70 main 0/16FB140 running
migration_check 127.0.0.1:55433 3823dd05e35d71f6ccf33049de366d70 main 0/16FB140 running
```
- New:
```
NODE ADDRESS TIMELINE BRANCH NAME LSN STATUS
main 127.0.0.1:55432 3823dd05e35d71f6ccf33049de366d70 main 0/16FB140 running
migration_check 127.0.0.1:55433 3823dd05e35d71f6ccf33049de366d70 main 0/16FB140 running
```
2022-05-04 12:12:26 -04:00
Anastasia Lubennikova
b8880bfaab
Bump vendor/postgres
2022-05-04 18:14:45 +03:00
Anastasia Lubennikova
e2cf77441d
Implement pg_database_size().
...
In this implementation dbsize equals sum of all relation sizes, excluding shared ones.
2022-05-04 18:14:45 +03:00
Arseny Sher
b68e3b03ed
Fix control file update for b9fd8a36ad
2022-05-04 17:11:22 +04:00
Arseny Sher
e58c83870f
Bump vendor/postgres to to send timeline_start_lsn.
2022-05-04 14:32:03 +04:00
Arseny Sher
b9fd8a36ad
Remember timeline_start_lsn and local_start_lsn on safekeeper.
...
Make it remember when timeline starts in general and on this safekeeper in
particular (the point might be later on new safekeeper replacing failed one).
Bumps control file and walproposer protocol versions.
While protocol is bumped, also add safekeeper node id to
AcceptorProposerGreeting.
ref #1561
2022-05-04 14:32:03 +04:00
Heikki Linnakangas
748c5a577b
Bump vendor/postgres. ( #1616 )
...
Includes fix for https://github.com/neondatabase/neon/issues/1615
2022-05-04 10:54:44 +03:00
Stas Kelvich
51a0f2683b
fix scram-proxy addresses
2022-05-04 01:35:30 +03:00
Dmitry Rodionov
9dfa145c7c
tone down tenant not found error
2022-05-04 00:47:52 +03:00
Stas Kelvich
5642d0b2b8
Change shutdown_process_on_error thread spawn settings.
...
Now princeple is following: acceptor threads (libpq and http) error will
bring the pageserver down, but all per-tenant thread failures will be treated
as an error.
2022-05-04 00:42:57 +03:00