Antalya 26.8: auto-grp-pr-2141: combined port of 13 PRs - #2399

Source-PR: #2141 (#2141)

…next commit)

---
Original cherry-pick message follows:

Merge pull request #2145 from Altinity/feature/antalya-26.6/auto-grp-pr-1687

Antalya 26.6: Cluster request improvements + Iceberg/Parquet read fixes
# Conflicts:
#	programs/server/Server.cpp
#	src/Common/ProfileEvents.cpp
#	src/Core/Settings.cpp
#	src/Disks/DiskObjectStorage/ObjectStorages/IObjectStorage.h
#	src/Interpreters/ClusterFunctionReadTask.cpp
#	src/QueryPipeline/RemoteQueryExecutor.cpp
#	src/QueryPipeline/RemoteQueryExecutorReadContext.cpp
#	src/Storages/ObjectStorage/DataLakes/Iceberg/ManifestFileIterator.cpp
#	src/Storages/ObjectStorage/StorageObjectStorageSource.cpp
#	src/Storages/ObjectStorage/StorageObjectStorageStableTaskDistributor.cpp
#	tests/integration/test_storage_s3/test.py
#	tests/queries/0_stateless/03413_experimental_settings_cannot_be_enabled_by_default.sql

Kept both sides where antalya-26.8 and the port add independent lines
(ProfileEvents rows, Settings declarations, obsolete settings, test
configs / experimental-settings exception list, `got_data_from_replica`
plus `replica_has_processed_data`, `read_source_index` plus
`file_meta_info`).

Dropped the cherry-pick's stale duplicates of code that antalya-26.8
already has elsewhere: the second copy of the shutdown `SCOPE_EXIT_SAFE`
block in Server.cpp (only `global_context->stopSwarmMode()` was added
into the existing block) and the duplicated `namespace ErrorCodes` block
in StorageObjectStorageSource.cpp.

Adapted: moved `deserializeFieldFromBinaryRepr` out of
ManifestFileIterator.cpp into Iceberg::IcebergFieldParseHelpers as the port
does, but carrying antalya-26.8's body (Decimal128/256 support added by
acb870c) instead of the port's older implementation.
Adapted: used antalya-26.8's `getSchedulingIdentifier()` helper (added by
cbd81e0) for the `unprocessed_files` keys and log message in
StorageObjectStorageStableTaskDistributor instead of the port's raw
path expressions.
Adapted: kept the `AsyncTaskExecutor` name argument required on
antalya-26.8 in RemoteQueryExecutorReadContext's constructor.

Source-PR: #2145 (#2145)

…next commit)

---
Original cherry-pick message follows:

Merge pull request #2146 from Altinity/feature/antalya-26.6/auto-grp-pr-1718

Antalya 26.6: Partition export + cluster functions
# Conflicts:
#	ci/jobs/scripts/integration_tests_configs.py
#	docs/reference/engines/database-engines/datalake.mdx
#	src/CMakeLists.txt
#	src/Common/ErrorCodes.cpp
#	src/Common/ProfileEvents.cpp
#	src/Common/setThreadName.h
#	src/Core/ServerSettings.cpp
#	src/Core/Settings.cpp
#	src/Core/Settings.h
#	src/Databases/DataLake/DatabaseDataLake.cpp
#	src/Databases/DataLake/DatabaseDataLake.h
#	src/Databases/DataLake/DatabaseDataLakeSettings.cpp
#	src/Databases/DataLake/GlueCatalog.cpp
#	src/Databases/DataLake/ICatalog.h
#	src/Databases/DataLake/RestCatalog.cpp
#	src/Databases/DataLake/RestCatalog.h
#	src/Databases/DataLake/S3TablesCatalog.cpp
#	src/Databases/DataLake/UnityCatalog.h
#	src/Disks/DiskObjectStorage/ObjectStorages/AzureBlobStorage/AzureObjectStorage.cpp
#	src/Interpreters/IcebergMetadataLog.h
#	src/Interpreters/InterpreterSystemQuery.cpp
#	src/Interpreters/PreparedSets.cpp
#	src/Interpreters/PreparedSets.h
#	src/Parsers/ASTSetQuery.cpp
#	src/Parsers/ASTSystemQuery.h
#	src/Parsers/FunctionSecretArgumentsFinder.cpp
#	src/Planner/Planner.cpp
#	src/Processors/QueryPlan/ReadFromRemote.cpp
#	src/Storages/IStorage.h
#	src/Storages/IStorageCluster.cpp
#	src/Storages/MergeTree/MergeTreeData.cpp
#	src/Storages/MergeTree/MergeTreeData.h
#	src/Storages/ObjectStorage/Azure/Configuration.cpp
#	src/Storages/ObjectStorage/DataLakes/DataLakeConfiguration.h
#	src/Storages/ObjectStorage/DataLakes/Iceberg/IcebergMetadata.cpp
#	src/Storages/ObjectStorage/DataLakes/Iceberg/IcebergMetadata.h
#	src/Storages/ObjectStorage/DataLakes/Iceberg/IcebergWrites.cpp
#	src/Storages/ObjectStorage/DataLakes/Iceberg/IcebergWrites.h
#	src/Storages/ObjectStorage/DataLakes/Iceberg/ManifestFileIterator.cpp
#	src/Storages/ObjectStorage/DataLakes/Iceberg/MultipleFileWriter.cpp
#	src/Storages/ObjectStorage/DataLakes/Iceberg/Mutations.cpp
#	src/Storages/ObjectStorage/DataLakes/Iceberg/PersistentTableComponents.h
#	src/Storages/ObjectStorage/DataLakes/Iceberg/SchemaProcessor.cpp
#	src/Storages/ObjectStorage/DataLakes/Iceberg/SchemaProcessor.h
#	src/Storages/ObjectStorage/DataLakes/Iceberg/StatelessMetadataFileGetter.cpp
#	src/Storages/ObjectStorage/DataLakes/Iceberg/Utils.cpp
#	src/Storages/ObjectStorage/DataLakes/Iceberg/tests/gtest_iceberg_schema_processor.cpp
#	src/Storages/ObjectStorage/ReadBufferIterator.cpp
#	src/Storages/ObjectStorage/StorageObjectStorage.cpp
#	src/Storages/ObjectStorage/StorageObjectStorageConfiguration.cpp
#	src/Storages/ObjectStorage/StorageObjectStorageConfiguration.h
#	src/Storages/ObjectStorage/StorageObjectStorageSource.cpp
#	src/Storages/ObjectStorage/registerStorageObjectStorage.cpp
#	src/Storages/ObjectStorageQueue/StorageObjectStorageQueue.cpp
#	src/Storages/ObjectStorageQueue/registerQueueStorage.cpp
#	src/Storages/StorageDistributed.cpp
#	src/Storages/StorageMergeTree.cpp
#	src/Storages/System/StorageSystemIcebergHistory.cpp
#	src/Storages/System/attachSystemTables.cpp
#	src/Storages/buildQueryTreeForShard.cpp
#	src/Storages/buildQueryTreeForShard.h
#	src/TableFunctions/TableFunctionObjectStorage.cpp
#	src/TableFunctions/TableFunctionObjectStorageCluster.cpp
#	src/TableFunctions/TableFunctionRemote.h
#	tests/integration/test_database_iceberg/test.py
#	tests/queries/0_stateless/01625_constraints_index_append.reference
#	tests/queries/0_stateless/03413_experimental_settings_cannot_be_enabled_by_default.sql
#	tests/queries/0_stateless/03745_system_background_schedule_pool.reference

Kept antalya-26.8 behaviour everywhere the cherry-pick only carried
pre-existing antalya-26.6 code, and translated the PR's real changes to
the current shape of antalya-26.8:

- Append-only registries (ErrorCodes, ProfileEvents, setThreadName,
  Settings/ServerSettings, obsolete settings): kept only the rows the PR
  adds, renumbering the new error codes after the ones antalya-26.8
  already uses.
- `IcebergSchemaProcessor`: took the PR's context-carrying signatures
  (`addIcebergTableSchema(ptr, context)`,
  `getSchemaTransformationDagByIds(context, ...)`, `getSimpleType(name,
  context, ...)`) and kept antalya-26.8's `getClickHouseTableSchemaById`
  spelling, adapting the call sites accordingly.
- `generateManifestFile`: appended the PR's `per_file_stats` after the
  extra defaulted parameters antalya-26.8 added, and named the
  intermediate defaults at the PR's call site.
- `StorageObjectStorageConfiguration::initialize` became an instance
  method, so the remaining static call sites (StorageURL,
  TableFunctionURL, registerQueueStorage) were converted.
- `RestCatalog`/`DeltaSharingCatalog`/`HorizonCatalog` (antalya-26.8-only
  subclasses) gained the `namespaces` constructor argument the PR adds to
  the base catalog.
- `MergeTreeData::changeSettings`: dropped the now-unused
  `has_storage_policy_changed` flag, since the PR replaced the
  conditional `startBackgroundMovesIfNeeded()` with an unconditional
  `startBackgroundMoves()` (exports run on the moves assignee).
- `registerTableFunctionObjectStorage` / `registerTableFunctionIceberg` /
  `registerTableFunctionDeltaLake` / `registerTableFunctionHudi`: dropped
  the registrations the PR moved into the new
  `TableFunctionObjectStorageClusterFallback`, keeping the antalya-26.8
  documentation for the functions that stay.
- Dropped the parts of "theirs" that antalya-26.8 already implements in
  another shape (lazy `insertRowToLogTable`, catalog-aware
  `getLatestMetadataFileAndVersionWithCatalog`, the parallel-replicas
  branch in `DatabaseDataLake::tryGetTableImpl`, the
  `RewriteInToGlobalInVisitor` copy in StorageDistributed) and the
  antalya-26.6-only test bodies that do not apply here
  (`test_partitioning_by_time`, the second result block of
  01625_constraints_index_append).

Source-PR: #2146 (#2146)

Antalya 26.6: Fix rescheduleTasksFromReplica

Source-PR: #2200 (#2200)

…next commit)

---
Original cherry-pick message follows:

Merge pull request #2201 from Altinity/feature/antalya-26.6/pr-1748

Antalya 26.6: Fix file identifier in rescheduleTasksFromReplica
# Conflicts:
#	src/Storages/ObjectStorage/StorageObjectStorageStableTaskDistributor.cpp

antalya-26.8 already carries the file-identifier unification the source PR
introduces as StorageObjectStorageStableTaskDistributor::getFileIdentifier:
the free function getSchedulingIdentifier(object_info, send_over_whole_archive)
is already used at all call sites, including rescheduleTasksFromReplica, and
uses the newer archive identifier scheme from "Preserve URL shard identity in
object tasks" (cbd81e0). Kept "ours" at every conflict and routed the
source PR's new code through the existing helper.

Adapted: source PR's getFileIdentifier(file) call in getNextTask routed to the
equivalent getSchedulingIdentifier(file, send_over_whole_archive) already on
antalya-26.8; the duplicate helper and its header declaration were removed.

Source-PR: #2201 (#2201)

Antalya 26.6: Make the export task timeout 24 hours instead of 1 hour

Source-PR: #2209 (#2209)

Antalya 26.6: Add commit info to partition exports table

Source-PR: #2210 (#2210)

…orect-order-partition-key

Antalya 26.6 Export partition - check name and pos of columns in partition key

Source-PR: #2218 (#2218)

…_matching_schema_export_partition_by_position

Atnalya 26.6 EXPORT PARTITION with position matching + extra columns in source

Source-PR: #2229 (#2229)

…rtition-monotonic-compat

Export partition (Antalya 26.6) - allow non matching partition expressions in case we can prove the destination expression does not split the data

Source-PR: #2253 (#2253)

…next commit)

---
Original cherry-pick message follows:

Merge pull request #2249 from Altinity/fix/join-filter-pushdown-through-rename

Fix join filter pushdown
# Conflicts:
#	src/Analyzer/Utils.cpp
#	src/Processors/QueryPlan/Optimizations/filterPushDown.cpp

Kept antalya-26.8's ANY INNER JOIN pushdown guard (used later in the function) after the new canPrefilterJoinSide assignments; dropped the logical_join Left/Right lines the PR replaces. Used std::deque<QueryTreeNodePtr> instead of the QueryTreeNodesDeque alias, which does not exist on antalya-26.8, and dropped the Core/Streaming/CursorTree_fwd.h include (context from the source branch, not part of the PR diff; the header does not exist here).

Source-PR: #2249 (#2249)

…iscovery_update

Reload cluster discovery settings from remote_servers without restart.

Source-PR: #2197 (#2197)

…olicy-commit-marker

Partition export - fix incomplete data on multi file export after restart

Source-PR: #2294 (#2294)