user
03/08/2024, 6:32 PMDeals Property History
and Companies Property History
to API v3
(#35662)
f09c97c connectors-qa: check cdk and language tags (#35685)
eabf39c GA release 4.0.0 (#35873)
0a9e0fe updated instructions for external logging (#35903)
55e6fbd Destination Snowflake: Handle NPE for state value. (#35899)
6b8cc39 Docs: Fix link in Core Concepts page (#35900)
1bb7a1c [source-postgres] State counter on postgres (#34724)
be6849f Source Ringcentral: add logo (#34242)
6f16ac5 📝 Updated Qdrant destination icon (#35104)
7d3a5f8 🤖 Bump patch version of Python CDK
4a808ee 🐛 follow up to #35471: update the cartesian stream slicer (#35865)
106102c 🤖 Bump patch version of Python CDK
858e61d Declarative CDK: Fix None error on stream_slice (#35879)
88314dd Source Metabase: Updates dashboards
stream, migrates to poetry (#35680)
6b26b27 speed up source-mssql tests (#35799)
666a3a3 source-mssql: reduce the number of containers used in tests (#35855)
0965ebd live-tests: add regression tests suite (#35837)
72eb8a6 ✨ Source Bing Ads: new streams: Audience Performance Report, Goals And Funnels Report, Product Dimension Performance Report (#35812)
8c862a8 Fix tags in metadata.yaml files: declare cdk tags (#35670)
fc03071 🐛 Source S3: Return iam docs (#35850)
df1cff1 Source Instagram: remove "total_interactions" from MediaInsights queries (#35875)
e4ccffb Docs: Tutorials formatting + from scratch connector tutorial cleanup (#33839)
4fcff41 [Source-postgres]: Add logging in case of multiple records with same LSN (#35842)
8ab77d4 Pass docker hub credentials to airbyte-ci's bump_version
command (#35802)
d5e91ae [source-mongodb] record count in state & initial iterator refactor (#35669)
8ee36d6 add background threads to MssqlTestDatabase (#35727)
aca8679 🐛 Destination Vectara: Improve title extraction logic (#35206)
da79f6e Destination Snowflake: Write extracted_at in UTC (#35308)
9ce9217 make query safer for servers that are case sensitive (#35816)
83cfcbf Source Microsoft Onedrive: Bump poetry.lock to upgrade transitive dependency (#35858)
cdf80f3 get source-mssql CI to green (#35721)
5f0d9c3 Source S3: upgrade dependencies to avoid transformers transitive dependency (#35857)
<https://github.com/airb…
airbytehq/airbyteJoe Bell (Airbyte)
03/11/2024, 4:55 PMuser
03/13/2024, 7:45 PM/telemetry
docs redirect (#36034)
7c0684d 🤖 Bump patch version of Python CDK
fd98267 configure debezium to correctly convert column with default value whe… (#36011)
95a8c8b Update linkedin-ads.md (#36030)
f679389 [airbyte-cdk] Fix tab delimiter configuration in CSV file type (#35901)
ef473c5 gradle: add kotlin support in all projects, warnings as errors (#36018)
d403d9b .editorconfig: add kotlin rules which approximate airbyte-ci format (#36017)
01da74e 🐛 [source-shopify] Fix discover command if shop name does not exist (#36000)
440df5d Archive Google Workspace Admin Reports (#35967)
b092a7f Disable Google Workspace Admin Reports in registries (#35965)
2ce32ab 🐛 Source Github: Handle rate limit exception as config error (#35986)
797ac00 🤖 Bump minor version of Python CDK
18f6515 Source Zoom: Fix authenticator bug and add missing fields (#35369)
75385c7 🤖 Bump patch version of Python CDK
15b9545 raise exception with the full class name if a class for a custom comp… (#35868)
5da29ac Source Amplitude: unpin CDK (#35987)
0113c52 🐛 Source Recharge: Add sort_by
to guarantee the records are in ASC
order (#35982)
36e9edd 🏥Source Mixpanel: fix expected records (#35964)
311e9f7 ✨Source Amazon Seller Partner: add GET_VENDOR_FORECASTING_REPORT
streams (#35954)
d804ff8 migrate live-test to a different repo (#35948)
c7e0d74 fix junit versionning mess (#35977)
a8b5296 Source Microsoft Onedrive: pin transformers transitive dependency (#35956)
c073e64 🤖 Bump patch version of Python CDK
b1f3b8a [airbyte-cdk] entrypoint wrapper should use per-stream state not legacy format (#35976)
ee6b1a0 [source-postgres] : Add retries back to the DBZ connector (#35904)
b09e560 [Docs] Edit recharge wording (#35975)
27d9207 Update enterprise setup guide for storage (#35966)
979b860 Source S3: pin transformers
transitive dependency (#35955)
3791a43 🐛 Source Shopify: Fixed bug when start date
was not provided, but the stream was using it (#35952)
a61f184 Update on-kubernetes-via-helm.md - 0.52.0 helm charts upgrade informa… (#35935)
46bf510 📝 Source Amazon Ads: Update tags in metadata.yaml (#35951)
4e05272 live-tests: add duckdb backend (#35923)
0bd29ba live-tests: pass connection id (#35922)
d6454f8 added integration instructions to getting started (#35861)
0f2685b 🤖 Bump minor version of Python CDK
2ac5248 Emit record counts in state messages for concurrent streams (#35907)
c8bec40 Improve Heartbeating External Docs. (#35934)
e66ec11 Better Heartbeating External Documentation. (#35932)
a4dca3b CDK: assert >0 state messages per read (fix tests) (#35906)
<https://github.com/airbytehq/airbyte/commit/acbdc2d6e1fc169bfe7df347f80fcd61662…
airbytehq/airbyteuser
03/14/2024, 12:00 AMcredit_ledger_entries
(#36036)
609d602 [Source-postgres] : Compare each record’s lsn_commit value instead of lsn_proc. (#35939)
airbytehq/airbyteuser
03/15/2024, 10:23 PMSTATE
messages frequency for the nested
sub-streams (#36170)
2c21cfe docs: fix or remove broken links (#36185)
0439fb3 Convert Async Destination Framework to Kotlin (#36033)
d243e0e 🎉 Source PayPal Transactions: Extend Disputes
stream schema with missing properties (#36173)
739287a upgrade launch darkly sdk to version 7.2.6 (#36013)
113e7e4 Add Enterprise API instructions (#36172)
3f3f866 [Docs] Release Notes for February 2024 (#35909)
0af41c4 update redshift docs (#36041)
2d7e1db [source-s3] Bump python-cdk version to include CSV tab delimiter fix (#36160)
ee999ee source-zoom: reference published version in breaking changes (#36135)
66bb8e9 java-cdk: change log level in log4j2-test.xml (#36023)
26b3db8 java-cdk: move log4j2-test.xml to test fixtures (#36021)
85c2929 java-cdk: prettier gradle dependency ordering (#36020)
737d9b4 java CDK: add static deserialize*(byte[]) methods to Jsons (#36019)
58eddcc Source Chargebee: Declare Unexpected Fields (#36037)
8e15d88 Update Issue Templates (#35896)
3fae982 extract out the connector changelog modification out of the bump_version code (#34586)
1d11ceb fix connector changelogs (#36039)
29b8afd Destination Redshift: Adopt CDK changes for airbyte_meta
(#35981)
ea2ca73 Source Greenhouse: unpin CDK (#35988)
bd83e35 Update on-kubernetes-via-helm.md (#35997)
1d6b93d Updated connector development overview doc (#36010)
airbytehq/airbyteJoe Bell (Airbyte)
03/18/2024, 5:50 PMuser
03/21/2024, 5:48 PM^0
(#36267)
2a9c91e remove dependency to java CDK sources (#36300)
34d36a2 [Source-mssql] : Remove mssql initial source operations (#36325)
d52f6b2 🤖 Bump minor version of Python CDK
01324ed bump CDK minimum python version to 3.9 (#36324)
157be91 ✨ File-based CDK: Add skip_wrong_number_of_fields_error
parameter for CSV parser (#36237)
bcd32a0 Resumable full refresh source-mongodb (#35845)
23b3d4e airbyte-ci: fix PR number ValueError
in migrate-to-poetry (#36319)
64fc7c7 Source Instagram: Unpin CDK (#36314)
5f78a37 📝 [docs] fix GCS documentation: avoid creating extra volumes and secret (#35973)
ccab316 Source Facebook Marketing: fix start_date selection behaviour (#36025)
5c26b69 📝Update certified connectors docs with full list of supported streams (#36235)
b581db6 🤖 Bump patch version of Python CDK
2f34f08 [ISSUE #6548] make all fields nullable except from pk and cursor field (#36201)
a38fdac 📝 [docs] fix small typo (#36052)
b7d8102 airbyte-ci: implement migrate-to-poetry connectors command (#35583)
e57252b Reworking Airbyte CI README: remove legacy connector_ops pieces (#36239)
bb478d5 Attempt to fix flakiness (#36258)
e5aea95 Custom convert incoming long for date and datetime types (#36263)
411115b Destination Redshift: Certification & docs update (#36255)
3339166 Update bing-ads.md (#36279)
838a50d Revert "sanity"
817dbe4 sanity
44f784e Remove most_recent_record
arg from Cursor.close_slice
(#36216)
f23881e Update supported-data-types and nullability (#36259)
8b849ab Source Typeform: Unpin CDK version (#36164)
f18e8e4 Add extensibility team to python connector approvers (#36248)
1a410aa Destination Redshift: Json transformer for graceful handling of large records (#36203)
a852963 Revert "Attempt to fix transient nightly build errors: Remove poetry … (#36206)
abb1d69 🤖 Bump patch version of Python CDK
240aa01 Airbyte CDK (low code): add refresh_token_error handler to DeclarativeOauth2Authenticator
(#36058)
36ae0cd 🤖 Bump minor version of Python CDK
ed3b87f java-cdk-destination: mark logs as debug (#36227)
875e5df low-code: Allow developers to use a custom schema loader (#36040)
e8c51cb 🚨🚨✨ Source Facebook Pages: Upgrade Facebook API to v19.0 (#36015)
80332d8 ✨ Source Microsoft SharePoint: Add parsing shared files (#35830)
f5c9a87 🏥 Source Twilio: Update expected records (#36228)
d77045d 🐛 Source Intercom: Fixed bug causing the header
val…
airbytehq/airbyteuser
03/22/2024, 12:44 AMJoe Bell (Airbyte)
03/22/2024, 11:20 PMuser
03/23/2024, 12:12 AMconversations
stream HttpError: 404 - User Not Found
(#36277)
878eb09 ✨ Destination DuckDB: track airbyte integration usage for MotherDuck (#36353)
b208835 Convert classes for destination-s3 to Kotlin (#36254)
0efbf23 do not log invalid message data (#36296)
33e9a81 Update cloud path in cdk publish pipeline (#36395)
374771c ✨ [source-orb] add end date parameter (#36288)
17a7e46 Destination Redshift: Suppress Jooq exception to avoid printing sql query (#36374)
ee48245 API merge instructions update (#36390)
8939298 ✨ Source Shopify: ensure Per-Stream Error Messaging and Record Counts In State (#36355)
991dc08 🤖 Bump minor version of Python CDK
242dd6a Airbyte CDK: request options allowed to be an array (#36357)
9f9dad1 Make destination-snowflake oAuth option hidden (#36240)
airbytehq/airbyteuser
03/26/2024, 12:28 AMsrc
so airbyte-ci
builds it (#36428)
b52c58d ✨ Source Microsoft OneDrive: Add fetching shared items (#35849)
4fae944 ✨ Source Microsoft SharePoint: Unpin CDK (#36381)
cc388fc airbyte-ci: allow empty pull request number for migrate-base-image
cmd (#36220)
3716a38 Fix missed PR number in airbyte-ci 4.6.1 changelog (#36423)
7fe4e23 destination-duckdb: fix formatting (#36415)
b9f6aab 🐛 Source Intercom: Fixed regression for the conversations
stream (#36414)
airbytehq/airbyteMarcos Marx (Airbyte)
03/26/2024, 9:15 PM$ref
instead of duplicating the entire parent stream definition
• All streams now point to a single shared base URL and Authenticator definition using $ref
instead of duplicating them in every stream
• Schemas are placed at the bottom of the YAML and pointed to with $ref
instead of being interleaved into the rest of the stream definition
• The YAML keys are now always ordered consistently by the Builder
• Top-level fields in the YAML are now separated by empty lines to improve readability
• Unused optional fields are now omitted from the YAML entirely instead of setting them to empty valuesuser
03/29/2024, 7:16 PMairbyte-lib
folder (#35910)
a2847fd 🤖 Bump minor version of Python CDK
c3c87ea follow up to #36294: allow migrate sub stream state with custom partition router (#36590)
23ecdb0 🐛 [source-slack] bump slack to 0.77.2 to emit record counts as float (#36579)
27c225a airbyte-ci: Update pipelines requests and pyjwt (#36607)
85d2469 🎉 Source Recharge: migrate to Low-Code (#35450)
ca6d722 ✨ Source Sentry: migrate to low code (#35755)
2b2f7ef 🎉 Source Zendesk Chat: migrate to YamlDeclarativeSource (Low-code)
(#35867)
f45db44 ci_credentials: add cryptography back 🙈 (#36614)
60456ea java-cdk: remove airbyte-api generation, pull dependency instead (#36610)
76e1057 disable some spotbugs checks for cdk tests (#36611)
45dae2c Source Mailchimp: fix acceptance tests (#36601)
552def8 disable spotbugs for CDK test and testFixtures submodules (#36606)
98e9956 Destination Postgres: airbyte_meta
, CDK upgrade and other fixes (#36363)
bbf77d6 ✨ Source Microsoft SharePoint: Update QL to 400 (#36573)
9df6aa9 Security: resolve cryptography-related warnings (#36597)
85ca7ec docs: fix pagination link header documentation (#36599)
c613853 airbyte-ci: Remove qa-engine in favor of connectors_qa (#36591)
3b50b0d connector-templates: Unpinning pytest and upgrading to recent base image version (#36596)
cc5d5d4 Bump requests from 2.25.1 to 2.31.0 in /airbyte-ci/connectors/common_utils (#36593)
5d48baf Bump black from 22.1.0 to 24.3.0 in /airbyte-cdk/python (#36568)
634db57 Python CDK: re…
airbytehq/airbyteuser
04/01/2024, 11:52 PMuser
04/02/2024, 9:32 PMuser
04/04/2024, 10:09 PMJoe Bell (Airbyte)
04/06/2024, 12:21 AMMarcos Marx (Airbyte)
04/11/2024, 6:48 PMJoe Bell (Airbyte)
04/13/2024, 3:24 PMuser
04/17/2024, 3:20 AMMarcos Marx (Airbyte)
04/19/2024, 6:33 PMabtcl
is Airbyte’s command line tool for running locally easy button airbyte rocket octavia thanks .
This week the engineering team released the abctl
tool.
This is a go package will make easier to install Airbyte in your local setup.
It is possible to install abctl
using the homebrew tap 🍺 :
• access is enabled by running brew tap airbytehq/tap
If you want to get more information check out the new deployment instructions where you can use abctl
to install Airbyte in 1 step.Joe Bell (Airbyte)
04/19/2024, 10:40 PMAngel Perez
04/23/2024, 12:55 PMPedro Lopez (Airbyte)
04/23/2024, 6:57 PMuser
04/23/2024, 7:23 PMpyarrow
batch insert as replacement of executemany
(#36715)
dfc933a DX: Add devcontainer configs for "Python generic" and "Default" (#34032)
54b0a7b MSSQL remove normalization (#36050)
8f6036e Live tests: update example in README to include --connection-id (#37470)
2836940 [source-MongoDB] Do not send estimate trace message if we don't have data (#37473)
9b9ec1c [source-postgres] : Remove legacy bad values handling code (#37445)
01381ae 🐛 Source Shopify: fix one-time
retry after Internal Server Error
for BULK streams (#37468)
5f1e4e6 source-twilio-taskrouter: ensure inline schemas, updated cdk, poetry (where possible) (#37278)
57a5943 source-zendesk-sunshine: ensure inline schemas, updated cdk, poetry (where possible) (#37302)
96f11a7 source-zapier-supported-storage: ensure inline schemas, updated cdk, poetry (where possible) (#37300)
33d1aca source-yahoo-finance-price: ensure inline schemas, updated cdk, poetry (where possible) (#37295)
66c7fef Docs (ci_credentials
): Add remote install instructions via pipx
(#35809)
614e15f [connector-templates] Switch python destination template to generate pyproject.toml instead of setup.py and requirements.txt (#37457)
383af5c Update salesforce.md (#19925)
d497014 🐛 Source Klaviyo: fix invalid path for '.coveragerc ' (#37439)
f493c7b Rename File format related classes to be agnostic of S3 (#37442)
7adfb7a 🐛 Source Salesforce and Stripe: Up CDK version to ensure config_errors are not translated as system_e… (#37448)
ef27741 Fix format (#37449)
7c85652 🤖 Cut version 0.83.1 of source-declarative-manifest
b110774 🤖 patch bump Python CDK to version 0.83.1
48af92a Concurrent CDK: if exception is AirbyteTracedException, raise this an… (#37443)
ebb57f0 pin zendesk-support 2.3.0 in cloud (#37446)
ae64db1 🤖 Cut version 0.83.0 of source-declarative-manifest
58cd487 🤖 minor bump Python CDK to version 0.83.0
b20cd1b ✨ airbyte-cdk - Adds JwtAuthenticator
to low-code (#37005)
<…
airbytehq/airbytePatrick Nilan
04/24/2024, 4:10 PMuser
04/26/2024, 1:10 AMairbyte-ci
(#37440)
c4ad3d9 convert destination-bigquery to kotlin CDK (#36899)
993aece [Source-mongo] : Implement fixed chunk size (1million) (#37559)
135e623 ✨ [source-zendesk-support] Fix the fields
data type to include the id
and value
(#36388)
07db1ca bump source-e2e-cloud version (#37583)
401eee7 bumping jsonschemafriend to 0.12.4 (#37581)
0de1b48 CI: Refactor commit and push steps of 'format-fix' workflow (#37580)
5629bb9 CI: fix missing slash command input args (#37564)
e172376 regression-test: automatically fetch connection candidates (#37384)
6399307 🐛 Source Mailchimp: fix date-time format issue for start_date
for email_activity
stream (#37572)
17a374e connectors-qa: add check for 'maxSecondsBetweenMessages' presence in certified connectors metadata (#36803)
3ca88e6 community-ci: upload reports as github action artifacts (#37571)
c578ee7 [Docs] Add schema propagation backfill feature (#37536)
ae022a6 community-ci: make the cdk test fail if they run on forks (#37569)
71ebd4a productionize community-ci
workflow (#37404)
e6b3874 CI: Fix git repo ref in format-check workflow (#37563)
5a56400 CI: fix git ref in format-check workflow (#37562)
f96d9f1 CI: Fix skip condition on forks (2 of 2) (#37554)
9b9f34e allow "java" connectors to be written in kotlin (#37485)
352fc28 🤖 Cut version 0.85.0 of source-declarative-manifest
fa2636c 🤖 minor bump Python CDK to version 0.85.0
8eb634c [Source-mongodb-v2] : Fix logic in determining whether a resume token is valid or not (#37557)
86ee91e Connector builder: read input state if it exists (#37495)
28209fd source-zenloop: ensure inline schemas, updated cdk, poetry (where possible) (#37304)
14820c5 CI: Fix fork check condition (#37553)
9459d4f source-marketo: ensure inline schemas, updated cdk, poetry (where possible) (#36650)
2e0e259 source-jira: ensure inline schemas, updated cdk, poetry (where possible) (#36646)
1c187e9 CI: Allow format fix on PRs from forks (#37393)
8aa506c airbyte-ci: add a contribution guide (#37533)
b339f1b 🐛 Source Zendesk Support: fix parse response for ticket metrics (#37450)
fce3409 bump s3 cdk version (#37546)
587e874 Remove excessive logs in counter (#37541)
d9ee103 [Source-mongo] : Adding a new iterator in preparation of adding chunking subqueries (#37525)
a384c59 Rbroughan/stream limits docs updates (#37526)
df67b36 🐛Source Rss: Fix Incremental Sync (#37535)
9eae446 🚨🚨 Source Linkedin Ads: Update pivotValues pk type for Ad Analytics streams (#37531)
d790b7d [Source-postgres] : Better error messages on switching between sync m… (#37509)
b5fef4e Live tests: update README (#37512)
c05c70b Sou…
airbytehq/airbyteLake (Airbyte)
04/30/2024, 6:58 PMIncremental Sync
is configured, the state
output by each partition can now be viewed in the testing panel, and users can set the Input state
to use for the next test read.
◦ This allows connector developers to verify that the incremental state matches the expected shape and is compatible with existing state, and to test how the connector responds to different input states.
◦ In the output state tab, there is also a Use as Input State
button which allows users to easily use the output state as the input state for the next test read with a single click
◦ See first 2 screenshots below for an example of how this looks in the UI
• The Authentication
component can now be switched to YAML-mode, allowing users to use custom authenticators (by following this guide) or authenticators that are not yet added to the UI
◦ This includes another subtle feature: when switching to YAML mode, any auto-created user inputs will remain and be "unlocked" so that users can modify them as they wish
◦ When switching the component back to UI mode, the required auto-created inputs are verified to have the required properties, and are re-locked upon switching to UI
◦ See the last screenshot below for an example of how this looks in the UI[DEPRECATED] Marcos Marx
We’re deprecating the standalone Airbyte API server and moving the routes into the Airbyte server. This will allow us to increase reliability (no more cross server HTTP calls) as well as decrease Airbyte’s deployment footprint. You should now be able to access the Airbyte API directly from the Airbyte server and all Airbyte API updates going forward will be made to that version of the API. Please review the documentation page for information on how to swap over to the new URLs by the target deprecation date.The
server
service will be deprecated on June 14.
You can access the new endpoints (airbyte-server
) now to update your applications and ensure seamless integration with future releases.
For detailed instructions and more information, please click here.user
05/02/2024, 3:15 PM202404
(#37573)
5574b07 Source Mailgun: Changed last recrods to last record (#37594)
ba796fd 🏥 Source Google Ads: Update expected records (#37763)
f46a3b5 Source Wrike: Changed last records to last record (#37600)
8a97537 airbyte-ci: add job id to dagger engine logs artifacts name (#37762)
0eadede community-ci: fix missing git info (#37760)
5a9137b 🤖 Cut version 0.86.2 of source-declarative-manifest
a2e4f5d community-ci: fix typo on workflow (#37759)
355b92c 🤖 patch bump Python CDK to version 0.86.2
7d5d4ff [Docs] Homepage video and product descriptions (#37692)
4ef8db6 community-ci: declare "early CI" (#37690)
a7102c9 🤖 patch bump Python CDK to version 0.86.1
2cfa6ea File-based CDK: fix schemas merge for nullable object types (#37619)
f7f7f7e Set debezium num retries property to zero (#37758)
4a49615 Update destinations/gcs.md (#37757)
deabdbb Add debezium engine logs (#37754)
a9ae97a bump metadata (#37755)
8913b22 Remove schema evolution from CDC docs and other tweaks (#37731)
6e6cc5c fix tagging for api sources (required reviewers) (#37728)
9c4e38d remove extensibility from required reviewers checks (#37716)
af975f4 Update required reviewer tests (#37724)
914f044 [Certified sources] : Bump cdk versions to disable DBZ retries (#37742)
db8fadc source-smartengage: ensure inline schemas, updated cdk, poetry (where possible) (#37261)
6cd8abf source-sonar-cloud: ensure inline schemas, updated cdk, poetry (where possible) (#37262)
6276c1f source-strava: ensure inline schemas, updated cdk, poetry (where possible) (#37266)
e9761eb source-timely: ensure inline schemas, updated cdk, poetry (where possible) (#37270)
e5bb6e1 source-todoist: ensure inline schemas, updated cdk, poetry (where possible) (#37272)
f390062 source-orbit: ensure inline schemas, updated cdk, poetry (where possible) (#37212)
03a9e3f source-orb: ensure inline schemas, updated cdk, poetry (where possible) (#37211)
3a0ebb3 source-opsgenie: ensure inline schemas, updated cdk, poetry (where possible) (#37210)
39eda24 source-openweather: ensure inline schemas, updated cdk, poetry (where possible) (#37209)
6583da6 source-open-exchange-rates: ensure inline schemas, updated cdk, poetry (where possible) (<https://github.…
airbytehq/airbyte