Skip to content

duckdb don't seems to read the iceberg table聽#387

Description

@djouallah

Apache Iceberg version

main (development)

Please describe the bug 馃悶

ok, I generated some data using the new release which is a fantastic works , but duckdb don't seems to understand it

https://colab.research.google.com/drive/1EjffJO75-8Rj4V0MGKUsoFHDOGgicKgK#scrollTo=OPH-dWMUlbhJ

Activity

  1. Fokko commented on Feb 7, 2024

    @Fokko
    Contributor

    Thanks for reporting this, including an example. It looks like there is an issue with the local URI's. Let me dig into this right away!

  2. Fokko commented on Feb 7, 2024

    @Fokko
    Contributor

    Hey @djouallah Thanks for raising this. I was able to reproduce this on the PyIceberg side. However, removing file:// from the warehouse directory fixed the problem. See #389

    I've also raised this on the DuckDB side: duckdb/duckdb-iceberg#38

    I know that you do a lot of benchmarking, and please share what comes out of it. I think we also might want to tune the page- and row-group sizes. #390 enables this.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions