Shulou(Shulou.com)05/31 Report--

This article mainly introduces the relevant knowledge of "python how to mine omelet fund portfolio data analysis". The editor shows you the operation process through an actual case. The operation method is simple, fast and practical. I hope this article "python how to mine omelet fund portfolio data analysis" can help you solve the problem.

1. Web page analysis 1. Open the web page

We randomly open a web page of the portfolio on the omelet fund, such as:

Take the Microsoft Edge browser as an example.

2. View json

Select "XHR" and find a file named with the fund number. Click it to view the request header.

Click download to view the details

GET / djapi/plan/CSI1033 HTTP/1.1Host: danjuanapp.comConnection: keep-alivesec-ch-ua: "Not Aten Brand"; v = "99", "Chromium"; v = "90", "Microsoft Edge"; v = "90" Accept: application/json, text/plain, * / * sec-ch-ua-mobile:? 0User-Agent: Mozilla/5.0 (Macintosh Intel Mac OS X 10: 15: 7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/90.0.4430.212 Safari/537.36 Edg/90.0.818.62elastic-apm-traceparent: 00-25105e3e8908ba33898b0f6cd57b8a73-c782a0e5122abe33-01Sec-Fetch-Site: same-originSec-Fetch-Mode: corsSec-Fetch-Dest: emptyReferer: https://danjuanapp.com/strategy/CSI1033Accept-Encoding: gzip, deflate, brAccept-Language: zh-CN,zh;q=0.9,en;q=0.8,en-GB;q=0.7,en-US Q=0.6Cookie: device_id=web_Skhu79T_v; acw_tc=2760774a16215745204941604e9286878fd10c566d03eedbbb0eb93c40e0f5; channel=undefined; xq_a_token=ccd9918c5b2c091c2d0dacb2e264963ba5fb7539; Hm_lvt_b53ede02df3afea0608038748f4c9f36=1621307606,1621428116,1621514481,1621574521; Hm_lpvt_b53ede02df3afea0608038748f4c9f36=1621574634; timestamp=1621574634698

Found that there seems to be nothing special, there may be no anti-climbing mechanism, you might as well try to click on this link directly.

Click download to view the details

Originally, what is stored in this is the json of the basic information of the fund!

Let's look at this address:

Https://danjuanapp.com/djapi/plan/CSI1033

It is found that as long as you change the final number, you can get the basic information of each fund.

2. Data acquisition 1. Observe the structure of json

Let's take a look at the structure of this json, and here only part of the fragment is intercepted.

{"data": {"plan_code": "CSI1033", "plan_name": "screws active preferred combination", "yield": "65.93", "yield_name": "earnings since its inception", "yield_middle": "48.03" "yield_name_middle": "annualized since its inception",. "found_date": "2020-02-03", "manager_xq_id": "3079173340", "manager_name": "bank screw", "manager_profile_photo": "https://danjuan.aiganggu.com/o2020021580801637267.png"," invest_time_type ": 2 "invest_time_name": "hold for more than 3 years", "invest_money_type": 4, "invest_money_name": "positive value-added", "found_days": 473," min_buy_amount ":" 200" "plan_derived": {"end_date": "2021-05-20", "nav_grtd": "- 0.03", "nav_grl1w": "2.38",. "unit_nav": "1.6593", "yield_history": [{"yield": "- 12.02", "name": "nearly 3 months"}, {"yield": "7.40" "name": "nearly 6 months"}, {"yield": "42.25",.

We find that all the data are stored under "data", the basic information of the fund is in "data", and the net value of the day is stored in "unit_nav" under "plan_derived", so we just need to get the data from it in this order.

Code implementation 1. Basic operation

a. Modules to be used

Get the page with requests and convert the json file into a dictionary with the json library.

Import requestsimport json

b. Casually set a request header

Header= {'User-Agent':' Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/88.0.4324.104 Safari/537.36'}

c. Get page information

The code here is the code of the fund. Read out the specific text content after getting the page with requests and save it in page.

Code='CSI1033'url=' https://danjuanapp.com/djapi/plan/'+codepage=requests.get(url,headers=header).text

Let's check the page output and find that everything we want is in it.

Click download to view the details

d. Import json

Since all the data is in data, we can go directly into data.

Items=json.loads (page) items=items.get ("data")

e. Get the information you need from json

Name of the fund

Name=items.get ('plan_name')

The net value of the day and the record date of the net value of the fund

These data are in "plan_derived".

Value=items.get ('plan_derived'). Get ("unit_nav") date=items.get (' plan_derived'). Get ("end_date") 2. Write a reusable function

Let's combine what we just did with code as the passed-in parameter.

Def getfund (code): url=' https://danjuanapp.com/djapi/plan/'+code page=requests.get (url,headers=header). Text items=json.loads (page) items=items.get ("data") value=items.get ('plan_derived'). Get ("unit_nav") date=items.get (' plan_derived'). Get ("end_date") name=items.get ('plan_name') print ("Fund number:", code,'\ nFund name:', name "\ nDate:", date, "net worth:", value) 3, complete code # by concyclicsimport requestsimport jsonheader= {'User-Agent':' Mozilla/5.0 (Windows NT 10.0) Win64 X64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/88.0.4324.104 Safari/537.36'} danjuan= ['CSI1033','CSI1032','CSI1038','CSI1029','CSI1006','CSI1065'] danjuan.sort () # get the current day information def getfund (code): url=' https://danjuanapp.com/djapi/plan/'+code page=requests.get (url) Headers=header). Text items=json.loads (page) items=items.get ("data") value=items.get ('plan_derived'). Get ("unit_nav") date=items.get (' plan_derived'). Get ("end_date") name=items.get ('plan_name') print ("Fund number:", code,'\ nFund name:', name, "\ n date:", date, "net worth:" Value) if _ _ name__=='__main__': for code in danjuan: getfund (code)

This is the end of the content of "how to mine omelet fund portfolio data analysis by python". Thank you for your reading. If you want to know more about the industry, you can follow the industry information channel. The editor will update different knowledge points for you every day.

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.