Cannot use an INSERT query with a special format

[YiuRULE]

ClickHouse handle different input as a format, for some case, it can be really useful to insert a file like a CSV/TSV for optimization purpose.

https://clickhouse.tech/docs/en/interfaces/formats/

According to the documentation, the requirement for the *args is only to be an iterable, but when we try to send an iterable who aren't a tuple, but who are just a list of string who represent a CSV, aiochclient crash as it's expect than we send a list of tuple when we do a INSERT query.

https://github.com/maximdanilchenko/aiochclient/blob/master/aiochclient/types.py#L365-L366

It would be really good for the library to have a feature to let more liberty for the developers to use formats who aren't only a simple list of tuple when we do an INSERT query

[maximdanilchenko]

@YiuRULE I have an idea to make an interface to insert a file-like stream or just string object of needed file type. Will it be good for you?

Smth like:

with open("values.json", "rb") as f:  # csv/tsv whatever 
    await client.execute(
        "INSERT INTO t VALUES FORMAT JSONEachRow", # or with kw format=formats.Json
        stream=f,  # may be another name, I don't know at this moment
    )

and some shortcuts for each type like:

with open("values.json", "rb") as f: 
    await client.insert_from_json_file("t", f)

[megazhuk]

Привет!
Есть какие-нибудь движения в эту сторону?
А то есть проблема вставки CVS. Если просто открывать файл и класть содержимое в виде строки в парааметр, то парсер БД видит непонятные в данных...

[Maksim-Burtsev]

@megazhuk Привет!

Вот метод клиента для вставки файлов.