SNOW-1812949 add get object and get bytes support for native arrow structured types #1968

sfc-gh-mkubik · 2024-11-18T11:00:38Z

Add getObject and getBytes implementations for native arrow structured types

The getString unification was already introduced to JDBC driver. This PR introduces changes for getObject and getBytes functions:

toObject on structure types would return object cast of StructObjectWrapper that contains both Object and String representation - to take the advantage of structure type and allow casting to Map or Array but also keep the backward compatibility with semi-structured types and return proper string representations
toBytes returns toBytes of the string representation of a structured type
also toBytes got added to the vector type as it wasn't available

PR branch is updated with all the changes from master branch
The code is correctly formatted (run mvn -P check-style validate)
New public API is not unnecessary exposed (run mvn verify and inspect target/japicmp/japicmp.html)
The pull request name is prefixed with SNOW-XXXX:
Code is in compliance with internal logging requirements

… type

…ormat ARROW is set

…, add variant test case

…parison

sfc-gh-mkubik and others added 22 commits October 29, 2024 18:57

return toStringResult for getObject and getBytes called on structured…

93e98ea

… type

fix formatting

3ae60f5

remove getBytes implementation from structured types converters

a55e26a

remove getBytes, add null check to getObject

2e86075

SNOW-1374896 Returning json string from method getObject when resultF…

c807e36

…ormat ARROW is set

Merge branch 'master' into SNOW-1374896-add-get-object-and-bytes-support

475f18d

address review comments

4a74df7

Merge branch 'master' into SNOW-1374896-add-get-object-and-bytes-support

b30bb71

fix formatting

219d3c5

remove variant from quotable type in ArrowStringRepresentationBuilder…

d1ca630

…, add variant test case

add toBytes returning toString.toBytes, make compatibility tests latest

230e935

fix formatting

8f58284

ensure UTF-8 is used for both expected and actual value in string com…

9d3d019

…parison

set getBytes charset to UTF-8

b62a4d9

change charset in JSON converter for varchar

9857661

use default charset in bytes assert

e001bbb

fix formatting

04a476d

ensure UTF-8 in getBytes assert

55e7135

remove charset from assert

f911113

remove UTF-8 charset specification from VarCharConverter

4681524

add charset to both VarcharConverter and BytesConverter for Varchar type

2f0032c

assert charset is utf-8

67e001b