java 与sas交互,与SAS的Hadoop连接

最新推荐文章于 2022-12-07 16:28:32 发布

weixin_39610722

最新推荐文章于 2022-12-07 16:28:32 发布

阅读量235

点赞数

文章标签： java 与sas交互

博主想使用SAS/ACESS 9.3M2 Interface连接SAS和Hive，询问SAS能否将Hive立方体导入其环境并查询，以及导入后与普通SQL立方体性能对比。还介绍了SAS/ACCESS的作用，如读写数据、处理数据类型转换等，以及其对Hadoop的访问功能。

摘要生成于 C知道，由 DeepSeek-R1 满血版支持，前往体验 >

I want to use SAS/ACESS 9.3M2 Interface for connecting sas with my Hive.

My question is,

whether sas imports hive cubes into sas environment and queries there?

or,

It again hits hive for the purpose of reporting so that it runs MR which degrades my reporting performance to more than 2-4 secs.

If it imports hive tables to its environment what would be its performance when compared to normal sql cubes?

I am totally new to sas i want my reports generated with in 2-4 secs where my aggregated data is in Hive tables and then I have created cube dimensions over that.

Thanks...

解决方案

What SAS/ACCESS serves for is to:

- provide you with ability to read data and write from/to a datasource, take care of data type conversions

- provides metadata about a datastore (list of tables, fields, datatypes)

- provide a mean to (also partially) translate (implicit pass-through) SAS code to datasource specific code (usually SQL variant etc)

- provide a mean for you to write a datasource specific code and sent it from SAS for execution in datasource

I'm totally new to Hadoop :-) so I'll just guess that SAS/Access to Hadoop (via LIBNAME statement) reads relational data from Hadoop, the documentation mentions JDBC, so I guess that's used for data access.

I'd doubt SAS/Access is able to query the cubes from Hadoop (is that your question?

- "I have created cube dimensions over that" - meaning in Hadoop?).

Generally SAS/Access tries to minimize data transfers from datasources and tries to push the processing to the datasource.

SAS/ACCESS to Hadoop

SAS/ACCESS provides the ability to access data sets stored in Hadoop in SAS natively. With SAS/Access to Hadoop:

LIBNAME statements can be used to make Hive tables look like SAS data sets on top of which SAS Procedures and SAS DATA steps can interact.

PROC SQL commands provide the ability to execute direct Hive SQL commands on Hadoop.

PROC HADOOP provides the ability to directly submit MapReduce, Apache Pig, and HDFS commands from the SAS execution environment to your CDH cluster.

The SAS/ACCESS interface is available from the SAS 9.3M2 release and supports CDH 3U2 as well as CDH 4.01 and higher.