setop
/
sqlite-parquet-vtable
mirror of https://github.com/cldellow/sqlite-parquet-vtable.git
1
0
Fork 0
Code Releases Activity
119 Commits 2 Branches 0 Tags 570 KiB
Commit Graph

119 Commits

Author SHA1 Message Date
Colin Dellow caefc23b1e Add a pg oracle 
- define `datetime`, `printf` fns in pg so it produces similar
  output as sqlite

- tidy up input data to be less wide

To do: some fns to make it easy to generate a new test case. Probably
want to mount all the 3 parquets simultaneously and refer to the
sqlite table by the same name as the pg table.
 2018-03-07 19:40:38 -05:00
Colin Dellow 0d4806ca6f Rejig parquet generation 
- "fixed_size_binary" -> "binary_10"
- make null parquet use rowgroups of sie 10: first rowgroup
  has no nulls, 2nd has all null, 3rd-10th have alternating
  nulls

This is prep for making a Postgres layer to use as an oracle
for generating test cases so that we have good coverage before
implementing advanced `xBestIndex` and `xFilter` modes.
 2018-03-06 21:02:26 -05:00
Colin Dellow 56245c1d3d test case for nulls 2018-03-04 22:48:39 -05:00
Colin Dellow 67005623df `ensureColumn` catches up when rows are skipped 2018-03-04 22:29:35 -05:00
Colin Dellow bb3a9440f7 Add query test framework, fix xFilter 2018-03-04 21:05:26 -05:00
Colin Dellow 4c54ab89ae Don't segfault on full table scan 2018-03-04 17:49:19 -05:00
Colin Dellow 7edb5e472f Support BLOBs 2018-03-04 17:20:59 -05:00
Colin Dellow f3e78408bf Update demo to use checked in parquet 2018-03-04 13:06:50 -05:00
Colin Dellow aea9469bff tweak wording 2018-03-04 13:04:58 -05:00
Colin Dellow a4f368af9c Add tests for unsupported types 2018-03-04 13:02:42 -05:00
Colin Dellow 681c8a443f Add tool to generate sample parquets 2018-03-04 12:15:50 -05:00
Colin Dellow 67b0d96967 float support 2018-03-03 20:57:09 -05:00
Colin Dellow 18f07f4c43 More defensive, add caveats 2018-03-03 20:30:46 -05:00
Colin Dellow eb0b48f867 Boolean, INT96, INT64 2018-03-03 20:00:50 -05:00
Colin Dellow 1de843fca8 Very rough first cut 
supports int32, double, strings.
 2018-03-03 15:44:01 -05:00
Colin Dellow f8599f8d3e Rename some references to CSVs 
...some nonsensical things, like "first row of Parquet",
but we'll tidy them up later.
 2018-03-02 19:18:36 -05:00
Colin Dellow 552da5a647 Initial checkin of CSV table 
parquet.cc is a fork of the sample CSV virtual table at
https://www.sqlite.org/src/artifact?ci=trunk&filename=ext/misc/csv.c

So far the only changes are those needed to make it compile cleanly in
C++11 mode.
 2018-03-02 18:59:34 -05:00
Colin Dellow 811badc9f9 Add script to fetch+build sqlite 2018-03-02 18:46:40 -05:00
Colin Dellow 8b9b3bcc9d
Initial commit 2018-03-02 18:37:08 -05:00