Add Python Framework and ProxyServer & ProxyClient - #1259
Merged
Conversation
Yicong-Huang
changed the title
zuozhiw
reviewed
Jul 23, 2021
zuozhiw
reviewed
Jul 23, 2021
zuozhiw
approved these changes
Jul 23, 2021
zuozhiw
left a comment
zuozhiw
left a comment
Contributor
There was a problem hiding this comment.
Looks very good, left two minor comments.
yangzhang75
pushed a commit
to yangzhang75/texera
that referenced
this pull request
Jun 22, 2026
This PR adds some python related files: 1. add python proxy layer (`ProxyServer` & `ProxyClient`), based on PyArrow Flight server and client. 2. add python's generated code for protobuf (with betterproto), and its generator script `core/scripts/python-proto-gen.sh`. 3. add dependency file `requirements.txt`. 4. add python tests with `pytest`. 5. add GitHub Action for python related tests.
Yicong-Huang
added a commit
to Yicong-Huang/texera
that referenced
this pull request
Jul 17, 2026
…#6110) ### What changes were proposed in this PR? Audits the explicit transitive pins in `amber/requirements.txt` and removes the two that serve no purpose. Verified with the pip dependency graph (`Required-by`) and a full `pip install --dry-run --report` resolution: | Pin | Verdict | Why | | --- | --- | --- | | `python-dateutil==2.8.2` | **Drop** | Required by six installed packages (pandas, botocore, betterproto, pg8000, aiobotocore, strictyaml) — always installed regardless. A `pip freeze` leftover from the original requirements.txt (apache#1259); every dependent declares `>=2.8`, so the pin only held us on a 2021 release. Resolves to 2.9.0.post0 | | `aiobotocore==3.7.0` | **Drop** | Hard dependency of s3fs; its version is already uniquely constrained by the `botocore==1.42.90` pin (aiobotocore's per-release botocore window is very narrow). Removing it eliminates a manual pairing hazard when bumping the boto3/botocore pins. Still resolves to 3.7.0 | | `s3fs`, `SQLAlchemy`, `pg8000` | Keep | Empty `Required-by` — pyiceberg only pulls them via extras, so dropping them would actually uninstall them (Iceberg S3 FileIO / SqlCatalog would break at runtime). pg8000 deliberately replaces LGPL psycopg2 (apache#3299) | | `setuptools==80.10.2` | Keep | Guards `fs`'s `pkg_resources` import against newer setuptools removing it (apache#4199); `fs` declares setuptools with no version bound | `amber/LICENSE-binary-python` updates `python-dateutil` to the resolved 2.9.0.post0 (it stays installed transitively, so the `check_binary_deps.py` gate still requires the claim); aiobotocore already claims 3.7.0, which is unchanged by the resolution. ### Any related issues, documentation, discussions? Closes apache#6108. Follow-up to apache#6101 / apache#6103. ### How was this PR tested? - `pip install --dry-run --ignore-installed --report` without the pins: resolution unchanged except python-dateutil → 2.9.0.post0; aiobotocore/botocore/boto3 stay at their current versions. - Upgraded the local venv to the resolved versions and ran the existing pyamber suite (`pytest -m "not integration"`) — passes. - CI's pyamber leg re-resolves from scratch and `check_binary_deps.py` verifies the LICENSE-binary-python claims. ### Was this PR authored or co-authored using generative AI tooling? Generated-by: Claude Code (claude-fable-5) 🤖 Generated with [Claude Code](https://claude.com/claude-code) --------- Signed-off-by: Yicong Huang <17627829+Yicong-Huang@users.noreply.github.com> Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
This PR adds some python related files:
ProxyServer&ProxyClient), based on PyArrow Flight server and client.core/scripts/python-proto-gen.sh.requirements.txt.pytest.