Skip to content

Release Spark Connector 2.11.2
Compare
Choose a tag to compare
@sfc-gh-mrui sfc-gh-mrui released this 20 Mar 22:54
· 34 commits to master since this release
v2.11.2-spark_3.3
8257da4

Added support sharing JDBC connection:

  1. Added support for using the same JDBC connection for different jobs and actions when the same Spark Connector options are used to access Snowflake.
    In previous versions, the Spark Connector created a new JDBC connector for each job or action.
    The Spark Connector supports the following options and API methods for enabling and disabling this feature:

    • To specify that the connector should not use the same JDBC connection, set the support_share_connection connector option to false. (The default value is true, which means that the feature is enabled.)
    • To enable or disable the feature programmatically, call one of the following global static functions: SparkConnectorContext.disableSharedConnection() / SparkConnectorContext.enableSharingJDBCConnection().
    • Note: In the following special cases, the Spark Connector will not use the shared connection:
      • If preactions or postactions are set, and those preactions or postactions are not CREATE TABLE, DROP TABLE, or MERGE INTO, the Spark Connector will not use the shared connection.
      • Utility functions in Utils such as Utils.runQuery(), Utils.getJDBCConnection() will not use the shared connection.

  2. Updated the connector to use the Snowflake JDBC driver 3.13.29.

Assets 2
Loading