Python - onenote lbm

Libraries to note

urllib - https://docs.python.org/3/library/urllib.html

openpyxl

https://automatetheboringstuff.com/chapter12/

Python tutorials to integrate the CSV files

https://www.datacamp.com/community/tutorials/python-excel-tutorial

looping through Lists

https://www.datacamp.com/community/tutorials/python-list-index

Data Manipulation Techniques

https://www.analyticsvidhya.com/blog/2016/01/12-pandas-techniques-python-data-manipulation/

Looping thru the dataframe

https://stackoverflow.com/questions/45670242/loop-through-dataframe-one-by-one-pandas

https://stackoverflow.com/questions/16476924/how-to-iterate-over-rows-in-a-dataframe-in-pandas

Python Documentation

https://docs.python.org/3/

Kaggle Kernels

how to refere a file in Kaggle Kernel

https://www.kaggle.com/getting-started/25930

Kernel Question

https://www.kaggle.com/c/mercari-price-suggestion-challenge/discussion/43939

urllib

https://www.kaggle.com/kosmos2017/testurllib?scriptVersionId=9973562

https://www.kaggle.com/hemantmehra/reading-data-into-kernel

--Reading CSV using Pandas

https://www.kaggle.com/michelj/read-data-and-simple-processing

https://www.kaggle.com/hemantmehra/reading-data-into-kernel

Splitting String and dictionaries

https://www.kaggle.com/rihadv/strings-and-dictionaries

How to separate List elements on a new line

https://stackoverflow.com/questions/6167731/printing-list-elements-on-separated-lines-in-python

How to Parse Excel fil in Python

https://stackoverflow.com/questions/26474693/excelfile-vs-read-excel-in-pandas

https://xlsxwriter.readthedocs.io/working_with_pandas.html

Sample script to read a file in Kernel

https://www.kaggle.com/michelj/read-data-and-simple-processing

Excel-Python

https://www.datacamp.com/community/tutorials/python-excel-tutorial

---CamlelCase to Snake_Case

import pandas as pd

import re

REG = r"(.+?)([A-Z])"

def snake(match):

    return match.group(1).lower() + "_" + match.group(2).lower()

df = pd.read_csv('../input/Accounts_Payable_csv.csv') # load data from csv

words = df['Column Physical_Name']

results = [re.sub(REG, snake, w, 0) for w in words]

print("\n".join(results))

URLLIB

https://docs.python.org/3.0/library/urllib.request.html

Code Beautifier

https://beautifier.io/

Webscraping samples

  

import requests

from bs4 import BeautifulSoup

# This code gets the latest details of the yellowdig team members using WebScraping techniques

# get the data

data = requests.get('https://yellowdig.com/our-philosophy/team')

# load data into bs4

soup = BeautifulSoup(data.text, 'html.parser')

team = soup.findAll('div', { 'class': 'apos-rich-text'})

for x in team:

print (x.text)

From <https://github.com/kajals/Python/blob/master/WebScraping>

http://www.compjour.org/warmups/govt-text-releases/intro-to-bs4-lxml-parsing-wh-press-briefings/

Nested find in BS4

https://stackoverflow.com/questions/37149955/find-third-occurring-p-tag-using-with-beautiful-soup

Beautiful Soup Documentation

https://beautiful-soup-4.readthedocs.io/en/latest/

Engineer Man Tutorial to revert back for Craigslist Scam

https://www.youtube.com/watch?v=UtNYzv8gLbs

https://github.com/engineer-man/youtube/blob/master/042/scrape3.py

Datascience Dojo

https://www.youtube.com/watch?v=XQgXKtPSzUI

http://www.compjour.org/

First Web Scraping Sample

https://github.com/theriley106/SneakerBotTutorials/blob/master/main.py

Python Bot

https://github.com/engineer-man/felix/blob/master/readme.md

https://www.onlinegdb.com/online_python_compiler

https://repl.it/@kajalsomaiya/ParallelImmenseFilename