Shulou(Shulou.com)06/01 Report--

This article will explain in detail how to use the application to access MaxCompute Lightning for data development. The content of the article is of high quality, so the editor will share it with you for reference. I hope you will have some understanding of the relevant knowledge after reading this article.

MaxCompute Lightning is an interactive query service for MaxCompute products, which supports accessing Maxcompute projects with PostgreSQL protocols and syntax connections, allowing you to use familiar tools to analyze data in MaxCompute projects with standard SQL queries and quickly obtain query results.

Many developers want to use the features of Lightning to develop data applications. Xiaobian will combine examples to show how Java and Python connect to access Lightning for application development (for reference, you need to replace it with the Endpoint and user authentication information of the region where your project resides).

Java uses JDBC to access Lightning

Examples are as follows:

Import java.sql.*;public class Main {private static Connection connection; public static void main (String [] args) throws SQLException {String url = "jdbc:postgresql://lightning.cn-shanghai.maxcompute.aliyun.com:443/your_project_name?prepareThreshold=0&sslmode=require"; String accessId = ""; String accessKey = ""; String sql = "select * from dual"; try {Connection conn = getCon (url, accessId, accessKey) Statement st = conn.createStatement (); System.out.println ("Send Lightning query"); ResultSet rs = st.executeQuery (sql); while (rs.next ()) {System.out.println (rs.getString (1) + "\ t");} System.out.println ("End Lightning query"); conn.close () } catch (SQLException e) {e.printStackTrace ();}} public static Connection getCon (String lightningsHost, String lightningUser, String lightningPwd) {try {if (connection = = null | | connection.isClosed ()) {try {Class.forName ("org.postgresql.Driver"). NewInstance (); DriverManager.setLoginTimeout (1) Connection = DriverManager.getConnection (lightningsHost, lightningUser, lightningPwd);} catch (Exception ex) {ex.printStackTrace ();} catch (Exception ex) {ex.printStackTrace ();} return connection;}}

2. Java uses druid to access Lightning

1.pom dependence

Com.alibaba druid 1.0.23 org.postgresql postgresql 9.3-1101-jdbc4

2.spring configuration

3. Code access

Public class LightningProvider {DruidDataSource druidDataSource; / * execute sql * @ param sql * @ return * @ throws Exception * / public void execute (String sql) throws SQLException {DruidPooledConnection connection = null; Statement st = null; try {connection = druidDataSource.getConnection (); st = connection.createStatement (); ResultSet resultSet = st.executeQuery (sql) / / A code for parsing and processing a pair of return values / / processing each row of data into a map ResultSetMetaData metaData = resultSet.getMetaData (); int columnCount = metaData.getColumnCount (); List rows = Lists.newArrayList (); while (resultSet.next ()) {LinkedHashMap map = Maps.newLinkedHashMap (); for (int iTunes 1) I > sys.stderr, ("Invalid Lightning' configuration"{}" .format (e)) sys.exit (1) try: conn = psycopg2.connect (conn_str) conn.set_session (autocommit=True) # This will disable transaction # started with keyword BEGIN # which is currently not # supported by Lightning' public service cur = conn.cursor () # execute Lightning' query cur.execute (sql) # get result result = cur.fetchall () except Exception, e: print > > sys.stderr ("Failed to query data through"Lightning: {}" .format (e)) finally: if conn: conn.close () return resultif _ name__ = = "_ _ main__": # step1. Setup configuration lightning_conf = {"dbname": "your_project_name", "user": "," password ":"," host ":" lightning.cn-shanghai.maxcompute.aliyun.com ", # your region lightning endpoint" port ": 443} # step2. Issue a query result = query_lightning (lightning_conf, "select * from test") # step3. Print result if result: for i in xrange (0, len (result)): print "Got% d row from Lightning:%s"% (I + 1, result [I])

4. Python uses ODBC to access Lightning

You need to install and configure the odbc driver on your computer now. The code example is as follows:

Import pyodbcconn_str = ("DRIVER= {PostgreSQL Unicode};"DATABASE=your_project_name;"UID=your_maxcompute_access_id;"PWD=your_maxcompute_access_key;"SERVER=lightning.cn-shanghai.maxcompute.aliyun.com;" # your region lightning endpoint "PORT=443;") conn = pyodbc.connect (conn_str) crsr = conn.execute ("SELECT * from test") row = crsr.fetchone () print (row) crsr.close () conn.close ()

Because Lightning provides PostgreSQL-compatible interfaces, you can develop Lightning applications in the same way that you develop PostgreSQL applications.

On how to use the application to access MaxCompute Lightning for data development is shared here, I hope that the above content can be of some help to you, can learn more knowledge. If you think the article is good, you can share it for more people to see.

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.