…hack/fast-import

It runs the command successfully. Doesn't try to attach it to the
pageserver on it yet

    BUILD_TYPE=debug DEFAULT_PG_VERSION=16 poetry run pytest --preserve-database-files test_runner/regress/test_pg_import.py

Doesn't work yet, I think because index_part.json is missing

…hack/fast-import

XXX: untested, not sure if it works..

…hack/fast-import

Test passes, yay!

It got pretty ugly after the last commit. Refactor it so that we first
collect all the key ranges that need to be written out into a list of
tasks, then partition the tasks into image layers, and then write them
out. This will be much easier to parallelize, but that's not included
in this commit yet.

… file")

This reverts commit ccf094a.

…ys, use it in test

…elBlockSize.MULTIPLE_RELATION_SEGMENTS] doesn't pass on mac)

…ing the parallel job results correctly

…d everything)

Conflicts:
	control_plane/src/bin/neon_local.rs
        we use clap derive now, had to adjust
	pageserver/client/src/mgmt_api.rs
	pageserver/src/tenant/storage_layer/image_layer.rs
        Chi persistent layer changes
	storage_controller/src/http.rs
	storage_controller/src/service.rs
        MutationLocations type was introduced upstream

Not-git conflicts:
    Heikki changed Python APIs to create branches, mypy caught it, fixed it

Motivation:
- clarity
- I will add a third variant for pgdata import in
  neondatabase/cloud#17507

Motivation:
- clarity
- I will add a third variant for pgdata import in
  neondatabase/cloud#17507

This reverts commit dd1ed55.

…ast-import

…start vanilla postgres

This works

christian@neon-hetzner-dev-christian:[~/src/neon]: RUST_BACKTRACE=1 ./target/debug/compute_ctl --connstr postgresql://cloud_admin@localhost:5432/postgres --pgdata ~/tmp/computectl --spec-path spec.json --pgbin ./pg_install/v14/bin/postgres

with

spec.yml:

format_version: 1.0
mode: FastImport
cluster:
  roles: []
  databases: []
skip_pg_catalog_updates: true

and

christian@neon-hetzner-dev-christian:[~/src/neon]: yq . spec.yaml > spec.json

…i for compute_ctl build (with this, compute image build works, command in message)

christian@neon-hetzner-dev-christian:[~/src/neon]: docker build --cache-from type=registry,ref=cache.neon.build/compute-node-v14:cache-x86 --build-arg DEBIAN_FLAVOR=bullseye-slim --build-arg GIT_VERSION=local --build-arg PG_VERSION=v14 --build-arg BUILD_TAG="$(date --iso-8601=s -u)"  -t neondatabase/compute-node-v14-x86:local -f compute/Dockerfile.compute-node .

… todo!() still open

…19d8d2f41f66e2c9

This reverts commit 471db5c.

…use shutdown raciness

Better idea: keep the timeline_creating guard alive, re-instantiate it during load.