Notes 6/25/23

 Notes 6/25/23

Add 2 pages to blog

https://uconn-sa.blogspot.com/

First is the SEC code from Wilton team

https://uconn-sa.blogspot.com/p/sec-query-api-obtaining-data-on-urls.html

SEC Query API - Obtaining Data on URLs for latest 10k filings   Specifications/Requirments/Notes: Gets the latest 10k filings from Tesla and Apple. Why we need this: in order to run sentiment analysis o... uconn-sa.blogspot.com



Second is a detail explanation on how to access the compute engine and create a python program to grab the latest price of any company you want.

https://uconn-sa.blogspot.com/p/access-compute-engine.html

Feel free to try this with a symbol that you chose.

Notes 6/20/23

 Notes 6/20/23

Great work from the UCONN team this week.

Were able to successfully extract prices of TSLA stock from yahoo finance using the yfinance python module and store that data into a datastore table(kind).

https://uconn-sa.blogspot.com/p/stock-prices.html

Stock Prices   Creation & Upload: import yfinance as yf import csv from google.cloud import datastore, storage from datetime import datetime tsla = yf.Ti... uconn-sa.blogspot.com



To build on this we need to:

1. Pull daily price instead of historical prices
2. Keep a table of stocks we want to pull prices for e.g. TSLA, MSFT, etc
3. Create a scheduled job that runs every day that pulls prices

https://cloud.google.com/scheduler

Cloud Scheduler | Google Cloud Fully managed cron service for scheduling virtually any job, including batch, big data jobs, and cloud infrastructure operations, with automated retries. cloud.google.com



The UCONN team also developed code to pull news out of Yahoo finance

https://uconn-sa.blogspot.com/p/news.html

To build on this code we need to:

1. Pull story or stories for that day for that symbol
2. Loop thru selected stocks to monitor
3. Store the story with headline in datastore
4. using Google sentiment record in datastore score and magnitude of headline and body of store
5. schedule job to run daily

https://uconn-sa.blogspot.com/p/sentiment.html

Great progress made this week.

Each team please report weekly progress before Friday's meeting.

Thanks

Sentiment   from google.cloud import language from google.cloud import language_v1 import six import pandas as pd data = pd.read_csv("all-data.csv", e... uconn-sa.blogspot.com



News   Body.py: import requests import yfinance as yf import csv from bs4 import BeautifulSoup tick = yf.Ticker("TSLA") news = tick.news news_arr... uconn-sa.blogspot.com



Notes 6/11/23

 Lets focus on Yahoo finance to collect and store data.

I've added 3 pages to the blog

The first page uses simple python Yahoo finance commands to pull data into the python program.

We are looking to pull date, stock price and trading volume into a datastore kind.

The teams should research and build programs to do this.

You can write this data to a csv file for reading

https://uconn-sa.blogspot.com/p/yfinance.html

Yfinance   https://analyzingalpha.com/yfinance-python Yahoo Finance offers an excellent range of market data on stocks, bonds, currencies, and crypto... uconn-sa.blogspot.com



The second link is the datastore code that takes a csv file and writes to datastore.

https://uconn-sa.blogspot.com/p/datastore.html

Datastore   https://github.com/uconnstamford/datastore #program1.py: this program loops into a csv file that has column format. As you initialize each... uconn-sa.blogspot.com



The last link uses Google sentiment analysis to score text.

Try to use first link to store yahoo news stores in a separate datastore table where this program can read that table and score each news story.

https://uconn-sa.blogspot.com/p/sentiment.html

Sentiment   from google.cloud import language from google.cloud import language_v1 import six import pandas as pd data = pd.read_csv("all-data.csv", e... uconn-sa.blogspot.com



Please make sure each team emails me a summary of progress before our Friday afternoon meeting.

Notes 6/8/23

 All gmail addresses submitted have been given full permission to the Google Cloud project sentiment analysis

I've created locations for the github code under /home/public

Linux primer https://uconnstamfordslp.blogspot.com/p/linux-explained.html

Linux explained   Linux Need to use gmail to set up google account with a credit card https://cloud.google.com/ When we talk about Linux we first must under... uconnstamfordslp.blogspot.com



to access ssh to instance-2 

Each team should provide a status report weekly for our Friday's meetings of what was accomplished.