This week in Databend #18

Databend aimed to be an open source elastic and reliable cloud warehouse, it offers blazing fast query and combines elasticity, simplicity, low cost of the cloud, built to make the Data Cloud easy.

Big changes

Below is a list of some major changes that we don't want you to miss.

Features

• add UserGrantSet struct to manage the privileges of an user or role by @flaneur2020 (#3149)
• add GitHub datasource by @Veeupup. (#3093)
• support load csv files via HTTP Stream by @sundy-li. (#3126)
• add ignore function which can be used in performance tests by @sundy-li. (#3177)
• support Projection push down for MemoryTable Engine by @ygf11 (#3154)
• insert overwrite stmt by @Veeupup. (#3150)
• add strings functions
  • POSITION, INSERT, LOCATE, base64 by @mshauneu (#3179, #3189, #3157, #3142)
  • HEX, UNHEX, QUOTE, LTRIM, RTRIM, OCT, REPEAT by @sunli829 (#3116, #3092)
  • ascii by @dust1 (#3131)

Improvement

• add monotonicity check for some functions by @junli1026 (#3134)
• refactor Catalog by @BohuTANG. (#3136)
• introduce distributed insertion by @dantengsky. (#2945)
• add time in http handler response by @youngsofun. (#3097)
• add ident to Change to indicate what resource is changed by @drmingdrmer (#3080)
• refactor insert values by @sundy-li. (#3101)
• string template function by @sundy-li. (#3139)

Performance Improvement

• simple chunk strategy in insertion by @dantengsky. (#3122)
• speed up min/max agg by @sundy-li. (#3163)
• fix performance fallback by @zhang2014. (#3140)

Bug fixes

• make table func case insensitive by @Veeupup. (#3191)
• fix compilation error on m1-mac by @drmingdrmer (#3166)

Tips

Let's learn a weekly tip from Databend.

How to load data into Databend

Databend now supports the loading of data via the following methods:

• Copy data from stage. > learn more
• Load data into a table using HTTP streaming API. > learn more

Changlogs

You can check the changelogs of Databend nightly to learn about our latest developments.

• v0.5.31-nightly
• v0.5.30-nightly
• v0.5.29-nightly
• v0.5.28-nightly
• v0.5.27-nightly

Ecosystem/Upstream

From open source, for open source. Our team is also committed to contributing to the Rust ecosystem and upstream dependencies.

• arrow2 #646: Improved performance in cast Primitive to Binary/String (2x): Reuse the temp bytes buffer. by @sundy-li
• release naive-cityhash v0.1.0: a naive native 128-bit cityhash v102 by @PsiACE
• octocrab #166: add issue_url in Comment model by @Veeupup

Meet Us

Please join the DatafuseLabs Community if you are interested in Databend.

We are looking forward to seeing you try our code. We have a strong team behind you to ensure a smooth experience in trying our code for your projects. If you are a hacker passionate about database internals, feel free to play with our code.

You can submit issues for any problems you find. We also highly appreciate any of your pull requests.

• Databend Website
• Twitter
• GitHub Discussions
• Slack Channel

如果想了解更多，可以关注公众号： Databend