Skip to content

Release v08#103

Merged
georgeRobertson merged 12 commits into
mainfrom
release_v08
Jun 10, 2026
Merged

Release v08#103
georgeRobertson merged 12 commits into
mainfrom
release_v08

Conversation

@georgeRobertson

@georgeRobertson georgeRobertson commented May 11, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

TLDR of changes

Features

  • Add additional field check into csv readers

Fixes

  • add greater error handling around polars and duckdb csv reader

Build

  • Upgrade supported Python versions to 3.12
  • Upgrade Pyspark to 3.5.2
  • Upgrade idna from 3.13 to 3.15 to resolve vulns
  • Upgrade pymdown-extensions from 10.21.2 to 10.21.3 to resolve vulns
  • Upgrade urllib3 from 2.6.3 to 2.7.0 to resolve vulns
  • Upgrade pytest from 8.4.2 to 9.0.3 to resolve vulns

What kind of changes does this PR introduce?

Tick all that apply

  • fix: A bug fix. Correlates with PATCH in SemVer
  • feat: A new feature. Correlates with MINOR in SemVer
  • docs: Documentation only changes
  • style: Changes that do not affect the meaning of the code (white-space, formatting, missing semi-colons, etc)
  • refactor: A code change that neither fixes a bug nor adds a feature
  • perf: A code change that improves performance
  • test: Adding missing or correcting existing tests
  • build: Changes that affect the build system or external dependencies (example scopes: pip, docker, npm)
  • ci: Changes to CI configuration files and scripts (example scopes: GitLabCI)

Please check if the PR fulfills these requirements

  • I have read and followed the Contributing guidance
  • Docs have been added / updated
  • Tests and Linting in the CI are passing
  • Changes have been reviewed and approved by a Project Maintainer

georgeRobertson2 and others added 7 commits May 11, 2026 17:13
@georgeRobertson2
build: bump python to 3.12 (#101)
22ad813 
* build: allow python 3.12 install with DVE

deal with typing issue on get_type_hints generated from bumping from 3.11 to 3.12

* style: upgrade pylint and dependencies and fix linting following upgrade

* build: upgrade pydantic from 1.10.16 -> 1.10.19

removed previous typing fix as pydantic upgrade fixes the typing issues in 3.12

* refactor: remove previously missed typing fix no longer needed

* build: lock all dependency versions

* build: upgrade moto to a supported python 3.12 version

* build: upgrade isort to version supported by python 3.12

* build: upgrade mypy to version supporting python 3.12

* build: update xlsx2csv to supported python 3.12 version and removed faker dependency
@georgeRobertson2
build: update pyspark to v3.5 (#102)
8d4b3c4 
* build: upgrade pyspark

pyspark from 3.4 -> 3.5.2 and delta spark 2.4 -> 3.2.0
@georgeRobertson
feat: add additional fields check into csv readers (#109)
f6d6424 
* feat: add additional fields check into csv readers

refactored the missing check in csv readers as well

* fix: add all available model fields to ensure that multiple models don't trigger additional fields check for csv

restructured the reader tests as well

* style: linting fixes
@georgeRobertson
build(deps-dev): bump idna from 3.13 to 3.15
00ba8bd 
resolve CVE-2024-3651
@georgeRobertson
build(deps-docs): bump pymdown-extensions from 10.21.2 to 10.21.3
e3f7708 
resolve regression on CVE-2023-32309
@georgeRobertson
build(deps): bump urllib3 from 2.6.3 to 2.7.0
cb8f45c 
upgrade urllib3 to prevent sensitive headers forwarded across origins in proxied low-level redirects
@georgeRobertson
build(deps-test): bump pytest from 8.4.2 to 9.0.3
61dc981 
resolve vuln tmpdir handling in pytest 8.4.2
@georgeRobertson georgeRobertson requested a review from stevenhsd June 5, 2026 19:15
@georgeRobertson georgeRobertson marked this pull request as ready for review June 5, 2026 19:15
@sonarqubecloud

sonarqubecloud Bot commented Jun 10, 2026

Copy link
Copy Markdown

Quality Gate Failed Quality Gate failed

Failed conditions
3.7% Duplication on New Code (required ≤ 3%)

See analysis details on SonarQube Cloud

@georgeRobertson georgeRobertson merged commit d2b9c81 into main Jun 10, 2026
3 of 4 checks passed
@georgeRobertson georgeRobertson deleted the release_v08 branch June 10, 2026 13:27
@georgeRobertson georgeRobertson mentioned this pull request Jun 10, 2026
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@stevenhsd stevenhsd Awaiting requested review from stevenhsd

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@georgeRobertson @stevenhsd @georgeRobertson2