Shulou(Shulou.com)06/02 Report--

This article focuses on "how to use python to obtain network disk data", interested friends may wish to take a look. The method introduced in this paper is simple, fast and practical. Now let the editor take you to learn "how to use python to obtain network disk data"!

With the copyright getting heavier and heavier, it has become more and more difficult to be a movie station, magnetic station, and novel station, while online disk search is relatively better due to relying on Baidu, but Baidu is also under increasing pressure. In fact, it is basically impossible to obtain data in this field. Fortunately, some teams have accumulated a lot of relevant data by virtue of their long-term data storage, which can be realized by calling data directly. At present, the better thing to do is spring onion computing, which is a platform discovered by Xiaobian recently. It is really easy to take a look at demo. Take python as an example:

#-*-coding: utf-8-*-# flake8: noqa__author__ = 'wukong'import urllibfrom urllib import urlencode# configure the appKey and openIdapp_key= you applied for "*" open_id= "* *" request_url request address params request parameters method request method "def request_content (request_url,params)" Method): params = urlencode (params) if method and method.lower () = "get": F = urllib.urlopen ("% slots% s"% (request_url, params)) else: F = urllib.urlopen (request_url) Params) content = f.read () print content def main (): domain= "http://api.xiaocongjisuan.com/" servlet=" data/skydriverdata/get "method=" get "request_url=domain+servlet # dictionary params = {} params [" appKey "] = app_key params [" openId "] = open_id # variable params [" Q "] =" a "params [" currentPage " "] = 1 params [" pageSize "] = 20 request_content (request_url Params,method) if _ _ name__ = ='_ main__': main ()

Java as an example:

Package com.xiaocongjisuan.module.example;import java.io.BufferedReader;import java.io.DataOutputStream;import java.io.IOException;import java.io.InputStream;import java.io.InputStreamReader;import java.io.UnsupportedEncodingException;import java.net.HttpURLConnection;import java.net.URL;import java.net.URLEncoder;import java.util.HashMap;import java.util.Map;public class Application {public static final String DEF_CHATSET = "UTF-8"; public static final int DEF_CONN_TIMEOUT = 30000 Public static final int DEF_READ_TIMEOUT = 30000; public static String userAgent = "Mozilla/5.0 (Windows NT 6.1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/29.0.1547.66 Safari/537.36"; / / configure the appKey and openId public static final String APP_KEY you applied for = "yours"; public static final String OPEN_ID = "yours" / / convert map type to request parameter type public static String urlEncode (Map params) {if (params==null) {return ";}; StringBuilder sb = new StringBuilder () For (Map.Entry I: params.entrySet ()) {try {sb.append (i.getKey ()) .append ("=") .append (URLEncoder.encode (i.getValue () + "," UTF-8 ")) .append (" & ");} catch (UnsupportedEncodingException e) {e.printStackTrace () }} String r=sb.toString (); if (r.endsWith ("&")) {r = r.substring (0meme r.length ()-1);} return r } / * * @ param requestUrl request address * @ param params request parameters * @ param method request method * @ return request result * @ throws Exception * / public static String requestContent (String requestUrl, Map params,String method) throws Exception {HttpURLConnection conn = null; BufferedReader reader = null; String rs = null Try {/ / Assembly request link StringBuffer sb = new StringBuffer (); if (methodological _ blank _ get URL url _ params ("get")) {requestUrl = requestUrl+ "?" + urlEncode (params);} / / default get URL url = new URL (requestUrl); conn = (HttpURLConnection) IgnoreCase () Conn.setRequestMethod ("GET"); if (post) {conn.setRequestMethod ("POST"); conn.setDoOutput (true); conn.setDoInput (true);} / / Parameter configuration conn.setRequestProperty ("User-agent", userAgent) Conn.setUseCaches (false); conn.setConnectTimeout (DEF_CONN_TIMEOUT); conn.setReadTimeout (DEF_READ_TIMEOUT); conn.setInstanceFollowRedirects (false); conn.connect () If (paramsfolk = null & & method.equalsIgnoreCase ("post")) {try {DataOutputStream out = new DataOutputStream (conn.getOutputStream ()); out.writeBytes (urlEncode (params));} catch (Exception e) {e.printStackTrace () }} / / read data InputStream is = conn.getInputStream (); reader = new BufferedReader (new InputStreamReader (is, DEF_CHATSET)); String strRead = null; while ((strRead = reader.readLine ())! = null) {sb.append (strRead) } rs = sb.toString ();} catch (IOException e) {e.printStackTrace ();} finally {if (reader! = null) {reader.close ();} if (conn! = null) {conn.disconnect () } return rs;} public static void main (String [] args) throws Exception {String domain= "http://api.xiaocongjisuan.com/"; String servlet=" data/skydriverdata/get "; String method=" get "; String requestUrl=domain+servlet; Map params=new HashMap (); params.put (" appKey ", APP_KEY) Params.put ("openId", OPEN_ID); / variable part params.put ("Q", "a"); params.put ("currentPage", 1); params.put ("pageSize", 20); String result=requestContent (requestUrl,params,method); System.out.println (result);}}

The document parameters of the platform are clearly written. You can view the data of the network disk. The returned results can be in two forms of json/xml:

{"data": {"result": [{"id": 15229, "title": "19.STM32+UCOSIII Development", "url": "https://pan.baidu.com/s/1jHVppmm"," size ":" 0B "," shareTime ": 1544196520000," shareUser ":" men****gwc " "isDir": "1", "originId": 1, "originName": "Baidu Network disk", "categoryId": 6, "categoryName": "folder (compressed)", "password": "1h7h", "acqTime": 1544196520000, "content": "File | 4 Program source code | 3 schematic diagram of STM32F1 V3 development board for Quintessential battleships | 2 video tutorials for STM32F1 V3 development boards for warships of Paradise warships | 1 ALIENTEK warship STM32F1 V3 development board introduction | contact us .pdf | STM32F1 development guide-library function version _ V3.1.pdf | STM32F1 development guide-register version _ V3.1.pdf | STM32F1 UCOS development manual _ V2.0.pdf | STM32F1 LWIP development manual (DM9000 version) _ V1.1.pdf | STM32F1 EMWIN development manual _ V2.0.pdf | 01 "," uk ":" 2568959939 "," shareId ":" 3221440608 "," fileCount ": 12 "fromTable": 5, "uniqueKey": "15a3c21502524cde3dca0602265d0de2", "shortUrl": "1jHVppmm", "extendFiles": [{"fsId": "679418566138045", "serverFilename": "File", "size": "0B"} {"fsId": "276424880413983", "serverFilename": "4 Program source code "," size ":" 0B "}, {" fsId ":" 512606928244026 "," serverFilename ":" 3 " ALIENTEK battleship STM32F1 V3 development board schematic "," size ":" 2.9 GB "}, {" fsId ":" 490793316644212 "," serverFilename ":" 2 " ALIENTEK battleship STM32F1 V3 development board video tutorial "size": "3.2 GB"}, {"fsId": "449624001387403", "serverFilename": "1 ALIENTEK battleship STM32F1 V3 development board introduction, "size": "3.7 GB"}, {"fsId": "934962552301526", "serverFilename": "contact us .pdf", "size": "283 MB"}, {"fsId": "151892956852061" "serverFilename": "STM32F1 Development Guide-Library function version _ V3.1.pdf", "size": "8.1 MB"}, {"fsId": "277550860315906", "serverFilename": "STM32F1 Development Guide-Register version _ V3.1.pdf" "size": "2.0GB"}, {"fsId": "675377464375217", "serverFilename": "STM32F1 UCOS Development Manual _ V2.0.pdf", "size": "3.3GB"}, {"fsId": "686926257121399" "serverFilename": "STM32F1 LWIP Development Manual (DM9000 version) _ V1.1.pdf", "size": "3.7 GB"}, {"fsId": "829790437997820", "serverFilename": "STM32F1 EMWIN Development Manual _ V2.0.pdf" "size": "12.2 MB"}, {"fsId": "383158876469280", "serverFilename": "01", "size": "0B"}]}], "amount": 1, "totalPage": 1, "time": 0.20107889 "currentPage": 1}, "errorMessage": "success", "errorCode": 0, "error": "success"} so far I believe you have a deeper understanding of "how to use python to obtain network disk data". You might as well do it in practice. Here is the website, more related content can enter the relevant channels to inquire, follow us, continue to learn!

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.