Today's Progress: Prepare GitHub Repo and Twitter, read documentation.
Thoughts: I will start with Python doing Master Python through building real-world applications but I would like to work on a PowerShell Module for Ansible.
Link to work:
Today's Progress: Prepare Python Script for Travis and Checking PyLint in all Python Files.
Thoughts: Unexpected script for Travis CI to check Lint in all Python Files in the Repo.
Link to work:
Today's Progress: Building an Interactive Dictionary.
Thoughts: I have learn that instead of type, isinstance can be used in a conditional, also learning about the difflib library to manage words similarities.
Link to work:
- See dictionary.py
Today's Progress:
- Create Volcanos in the US Script and play with folium module
- Improve pylint_check.py script
- Improve PyLint to have better code
- Improve Data Read in File Path
Thoughts: Good Module to create maps (folium)
Link to work:
- See map.py
- See choropleth.py
Today's Progress:
- Create documentation with Sphinx and readthedocs.io
Thoughts: Important for Company Projects and Documentation as Code
Link to work:
Today's Progress:
- Adding Pre-Commit to Project and Changing PyLint for Rating
- Creating Site Blocker for Working Hours
Note
Need to create more stable pre-commit based in score and not rc as in CI.
Thoughts: Good way of doing CI with python by score.
Check the following code to find matches in lines iterating a list:
>>> for line in CONTENT: ... if not any(website in line for website in WEBSITE_LIST):
Link to work:
- See pylint_check.py
- See pre-commit-config
- See webblocker.py
Today's Progress:
- Studying about decorators
- Continuing Improving pylint_check.py utility
Thoughts: Now clearer how using them, but still need to use them more frequently (Logging and Flask)
Link to work:
- See decorators
- See pylint_check.py
Today's Progress:
- Using Flake8 also for Pre-Commit and Fixing Other Lint Issues
- Adding Code Complexity to Travis (Just Reporting)
Thoughts: Still need to work with py.test and unittest to understand better different scenarios. Adding radon for Code Complexity
Link to work:
- See radon_check.py
Today's Progress:
- Flask Tutorial Completed
Thoughts: Need to work more with Flask to understand better its complexity
Link to work:
- See Flask Tutorial
Today's Progress:
- Working with sockets. Creating Basic Client and Server
Thoughts: Basic Socket Connectivity and Fixing Linters and some bugs in the Linting Script. Learning about how to skip a specific pylint in a specific file.
Link to work:
Today's Progress:
- Working with sockets. Creating Advanced Client and Server
Thoughts: Need to study more about sockets and focus on how to apply on infra and network debugging tools
Link to work:
Today's Progress:
- Playing with fbprophet, Forecast from Facebook
Thoughts: Nice one to understand how to play with dates and Pandas and doing some data forecasting with Python
Link to work:
Today's Progress:
- Docker Creation for Data Science
- Matplotlib Tutorial
Thoughts: Good Docker to Play with DataScience and Jupyter without breaking my environment
Link to work:
Today's Progress:
- Created Speech Recognition Script with Command Execution
Thoughts: Google Speech Recognition works fine. Probably quite slow if you are impatient ;)
Link to work:
Today's Progress:
- Created Men Restroom Algorithm
Thoughts: Idea from Reddit
Link to work:
Today's Progress:
- Adding Threading and Average to Men Restroom Algorithm
Thoughts: Investigating Threading although not easy to stop process when list is full. Needs further investigation
Link to work:
Today's Progress:
- Fixing Wifi and Code for Python 3 for DisplayOtronHat from Pimoroni
Thoughts: Wifi Display didn't work in Python3 due to the map/list difference
Link to work:
Today's Progress:
- Adding Some Wifi and Inky from Pimoroni examples and Thinking about some Men Restroom algorithm changes
Thoughts: Not easy to split men in stall. Need some thoughts to distribute them.
Link to work:
- See Men RestRoom Python
- See InkyTest
- See WifiTest
Today's Progress:
- Starting Machine Learning Project Walk-Through in Python
Thoughts: Nice one to settle ML knowledge.
Link to work:
Today's Progress:
- Continuing with Machine Learning Project Walk-Through in Python
Thoughts: Need to focus in the two variables plot as from there the data is not properly working. I will investigate how to fix it.
Link to work:
Today's Progress:
- Continuing with Machine Learning Project Walk-Through in Python
- Finishing Men Restroom Algorithm. Now supporting taking alternate further stalls to the door
Thoughts: Fully Working Projects Now. Need to finish Voice Recognition with API, Swagger and SQLLite
Note
For the ML Project, only finished first part
Link to work:
Today's Progress:
- How to Generate FiveThirtyEight Graphs in Python
- Understanding Data Wrangling
Thoughts: Find the way to create beautiful plots with Python
Link to work:
- See Machine Learning Walk-Through
- See Original Documentation from DataQuest
- See A Comprehensive Introduction to Data Wrangling
- See Data Wrangling Code
Today's Progress:
- How to Build a Python GUI Application With wxPython
Thoughts: Easy to implement, issues with Mac OSX (Class FIFinderSyncExtensionHost)
Link to work:
Today's Progress:
- Interactive Data Visualization in Python With Bokeh
Thoughts: First Part of the Tutorial from Real Python
Link to work:
Today's Progress:
- An Intro to Threading in Python
Thoughts: Tutorial from Real Python. Need to check how to launch two threads from outside the function in the MensRoom Algorithm
Link to work:
Today's Progress:
- Interactive Data Visualization in Python With Bokeh
- Adding FileSystem Magic
Thoughts: Second Part of Bokeh Tutorial from Real Python. Also added Util Filesystem examples
Link to work:
- See Bokeh Data Visualization Code
- See Original Bokeh Documentation from Real Python
- See FileSystem Magic Code
- See Original FileSystem Magic Documentation from Will Mcgugan
Today's Progress:
- Machine Learning CookBook. Understanding Basics
Thoughts: Creating Plots to understand the different ML Algorithms and when to use them
Link to work:
Today's Progress:
- Machine Learning CookBook. Outliers
- 200 Python Problems
Note
IMHO, for the 200 Python Problems in Udacity there are better solutions than the exposed. I keep mine in the code as I consider easier to implement in some cases and more accurate in others.
Thoughts: Learning about Outliers and Continuing Playing with Python Challengues
Link to work:
Today's Progress:
- Couple of Py, one to understand Binary Search and Decorator for Time Measurement
Thoughts: Very useful decorator for future Python Code.
Link to work:
- See Binary Search
- See Time Decorator
Today's Progress:
- Playing With Python Types, Part 1
Thoughts: Python 3 Types. Annotations and Comments
Link to work:
Today's Progress:
- Playing With Python Types, Part 2
Thoughts: Python 3 Types. Annotations and Comments. Cards Deck
Link to work:
Today's Progress:
- Continuing with 200 Problems and Adding Recursive Example from Grokking Algorithms Book
Thoughts: One of the best Algorithm Books and with Python Concepts and Examples
Link to work:
Today's Progress:
- Supercharge Your Classes With Python super()
Thoughts: Too complicated in complex code. Be careful using it
Link to work:
- See Code
- See Documentation in Real Python
Today's Progress:
- Creating a GUI Application for NASA’s API with wxPython
Thoughts: Learning Code. Although finished, I will take another day studying it
Link to work:
- See Code
- See Documentation Mouse vs Python
Today's Progress:
- Working with functions and decorators
Thoughts: Continuing with Complex Decorators and Functions
Link to work:
- See Code
- See Documentation in Real Python
Today's Progress:
- Continuing Working with functions and decorators
Thoughts: Continuing with Complex Decorators and Python Inner Functions
Link to work:
- See Code
- See Documentation in Real Python
Today's Progress:
- Finalizing decorators
Thoughts: Continuing with Complex Decorators and Classes Decorators
Link to work:
- See Code
- See Documentation in Real Python
Today's Progress:
- Thinking Recursively
Thoughts: Recursive Functions as learned in Grokking Algorithms Book
Link to work:
- See Code
- See Documentation in Real Python
Today's Progress:
- Lambda, Args and Kwargs exercises
Thoughts: Really easy so far to understand. Now is the time to play with these concepts and understand them quickly
Link to work:
Today's Progress:
- Sammy’s Generators in Python
- Things you’re probably not using in Python 3 – but should
Thoughts: One pending from long time ago, another cool one about Python 3
Link to work:
- See Code
- See Documentation in Medium
- See Code
- See Documentation in Data, what now?
Today's Progress:
- Faster Parallel Python with ray
Thoughts: Ray is really nice one to give it a try. Easy to install and implement.
Link to work:
- See Code
- See Documentation in Medium
Today's Progress:
- Speed Up Your Python Program With Concurrency
Thoughts: Threading, AsyncIO and Multiprocessing
Link to work:
- See Code
- See Documentation in Real Python
Today's Progress:
- Web Scraping with Scrapy: Advanced Examples
Note
Whole week busy reviewing Python for Games Book.
Thoughts: Nice to see but doesn't add inmediate value to my projects. Most of the examples found are incompleted or not properly documented.
Link to work:
- See Code
- See Documentation in Kite.com
Today's Progress:
- Logging, Setter and Pointers Like in Python
- Change Travis Version to 3.7
Note
Whole week busy reviewing Python for Games Book.
Thoughts: Still checking logging. Need to find a better way to setup Travis CI for only commited files
Link to work:
- See Code for Logging
- See Code for Pointers
- See Code for Decorators
- See Logging Documentation in Real Python
- See Pointers Documentation in Real Python
Today's Progress:
- Functional programming from Julien Danjou Blog
- Custom Exceptions from Dan Bader
- Logging Debugging
- Some Linter Fixing
Thoughts: Nice to see but doesn't add inmediate value to my projects. Most of the examples found are incompleted or not properly documented.
Link to work:
- See Code for Functional Programming
- See Code for Custom Exceptions
- See Code for Logging
- See Documentation in julien.danjou.info for Functional Programming
- See Documentation in dbader.org for Custom Exceptions
- See Logging Documentation in Real Python
Today's Progress:
- Prometheus and ML for Kubernetes Scale
Thoughts: Good Linux Academy Training to understand Prometheus API and reinforce ML Concepts for Linear Regression.
Link to work:
- See Code
- See Course on Linux Academy
Today's Progress:
- Script to Update Git Repositories given a path
Thoughts: I have used git commands instead git module to use standard libraries
Link to work:
- See Code
Today's Progress:
- Refresh some ML Concepts - Linear Regression
Thoughts: Good to remember some concepts and code as this is not in my daily tasks
Link to work:
- See Code
- See Training on GitHub
Today's Progress:
- Python Curses Tutorial. Wrapper and CleanUp added to centertext.py
Thoughts: Nice tutorial to implement in shell scripts. I will modify yesterday's script for better output
Link to work:
- See Code
- See Document on Dev_Dungeon
Today's Progress:
- Refresh some ML Concepts - Regularization
Thoughts: New Concepts Ridge and Lasso to avoid Overfitting
Link to work:
- See Code
- See Training on GitHub
Today's Progress:
- Learning and Refreshing some ML Concepts - Cross Validation and Decision Trees
Thoughts: Cool Maths explaining Decision Trees and Gini Index
Link to work:
Today's Progress:
- Python Concepts Classes, Instances and Static Methods
Thoughts: Studying Different Python Concepts and Tricks
Link to work:
Today's Progress:
- Creating Twitter Bot
Thoughts: Create Toy to play with Twitter API
Link to work:
Today's Progress:
- Continue with Twitter Bot
Thoughts: Continue with Toy to play with Twitter API
Note
Got the Docker properly working as there is a missing line in the Documentation.
Link to work:
Today's Progress:
- OOP with Python vs Java
Thoughts: Few refreshes and some new cool concepts for Python OOP
Link to work:
- See Code
- See Documentation in Real Python
Today's Progress:
- ML Concepts - K-Nearest Neighbors and Naive Bayes
Thoughts: Good to remember some concepts and code as this is not in my daily tasks
Link to work:
- See Code
- See Training on GitHub
Today's Progress:
- ML Concepts - Logistic Regression
Thoughts: Tomorrow I will check more code and more tutorials about this ML Topic
Link to work:
- See Code
- See Training on GitHub
- See Medium Article about LR
Today's Progress:
- ML Concepts - Logistic Regression and SVM
Thoughts: Checking more Tutorials about LR, needs to study even more
Link to work:
- See Code
- See Training on GitHub
- See Medium Article about LR
- See Code
Today's Progress:
- Improve Linter Scripts
Thoughts: Check only uploaded code compared with devel branch
Link to work:
- See pylint_check.py
- See radon_check.py
Today's Progress:
- Unify Linter Scripts to lint_checker.py
Thoughts: Unify linter scripts to have only one with a configuration file. Keeping old ones as reference
Link to work:
- See lint_checker.py
Today's Progress:
- AsyncIO in Python
Thoughts: First part of this really nice tutorial. I have to study deeply the rand code.
Link to work:
Today's Progress:
- AsyncIO in Python. Chained Code.
- Adding Technical Debt in Python
Thoughts: Second part of this really nice tutorial. Spending Three days on technical debt for pre-commit. See also pre-commit config.
Link to work:
- See Code
- See Code
- See pre-commit config
- See Original Documentation from Real Python
Today's Progress:
- New Ansible Module for Datalake ACLs
Thoughts: Working the whole week to get this module.
Link to work:
- See Code
Today's Progress:
- New Ansible Module for SP Creation
- Ansible Datalake ACLs improvement
Thoughts: Busy with my new project. These last module is the starting point to improve the SP Creation. Other features need to be added as password generation or expiration date.
Link to work:
Today's Progress:
- New Ansible Module for Datalake directory creation
Thoughts: Quick one from the Datalake acl creation.
Link to work:
- See Code
Today's Progress:
- Starting with Go
Thoughts: Time to start with Go thinking on cloud developments.
Link to work:
Today's Progress:
- Second Go Lesson. Basics
Thoughts: Finishing Variables
Link to work:
Today's Progress:
- Improving Ansible Module for Datalake ACLs before PRing to Ansible
Thoughts: Previous to tests, this module is a good one for Ansible Azure.
Link to work:
- See Code
Today's Progress:
- Some go and some python gpu tests
Thoughts: Really busy at work but I still have time to do some programming ;)
Link to work:
Today's Progress:
- Madrid Bicimad Time Series
Thoughts: Playing with Bicimad data and getting some cool graphs from it
Link to work:
- See Code
Today's Progress:
- Graph Algorithms from Grokking Algorithms
Thoughts: Understanding Graph Algorithms from this great book
Link to work:
- See Code
Today's Progress:
- Greedy Algorithms from Grokking Algorithms
Thoughts: Understanding Greedy Algorithms from this great book
Link to work:
- See Code
Today's Progress:
- Start Learning PyTest
Thoughts: Just realized that I'm not good at all at unit testing. I need to learn how to do good testing with Python. This is the first stage and probably would take over 10 to fully understand it.
Link to work:
- See Code
Today's Progress:
- Continue with PyTest
Thoughts: Second PyTest Session. Fixtures
Link to work:
- See Code
Today's Progress:
- Docker Signal Management for K8S
Thoughts: Some testing with K8S Configuration, Docker and Python
Link to work:
- See Code
Today's Progress:
- Continuing with Python Testing
Thoughts: Discovered bandit for security flaws testing. Continuing with testing with unittest
Link to work:
- See Code
Today's Progress:
- MongoDB Tests with Docker
Thoughts: Adding some MongoDB testing. Just easy functions.
Link to work:
- See Code
Today's Progress:
- Add emailcrawler python (Lost source)
Thoughts: Study and play with bandit with this Python code. Don't like too much but gives me several ideas.
Link to work:
- See Code
Today's Progress:
- AsyncIO in Python. areq.py Code.
Thoughts: Third part of this really nice tutorial.
Link to work:
Today's Progress:
- Python Performance with pytest-benchmark mostly
Thoughts: Didn't know about pytest-benchmark with this part, I'm learning also about how to create better python tests.
Link to work:
Today's Progress:
- Python Performance: Finding bottlenecks with cProfile
Thoughts: Didn't know about cProfiling. Testing different visual tools for debugging and performance
Link to work:
Today's Progress:
- Machine Learning: Detecting Fake News
Thoughts: Use scikit learn with Passive Aggressive Classifier
Link to work:
Today's Progress:
- Python Performance: Profiling memory usage with memory_profiler
Thoughts: Finding Memory Issues using this module. Also discovered the __slots__ dunder, although it has a drawback: It prevents the addition of attributes other than the ones specified in it.
Link to work:
Today's Progress:
- Build a Mobile Application With the Kivy Python Framework
Thoughts: Easy to implement and understand
Link to work:
Today's Progress:
- Learn object-oriented programming with Python
Thoughts: Just Playing with more OO Programing. Adding Detect-Secrets to Code whether on pre-commit and build
Link to work:
Today's Progress:
- Discovering Logzero for Logging
Thoughts: I love this one. Colourful and easy to use. I'm quite slow finishing this project as other projects are alive
Link to work:
Today's Progress:
- Playing with email
Thoughts: Good to have this code for email. Check documentation attached to this project for reference.
Link to work:
Today's Progress:
- Ansible Plugin and Filter
Thoughts: lookup plugin to merge lists from a given key and filter to get a Microsoft SAS Token
Link to work:
- See Code
- See Ansible Developer Guide
Today's Progress:
- OpenDNS Updater
Thoughts: As the opendns updater doesn't work for macos, I have developed my own. Simple one for now, but I will improve it in the future, probably with some UI and logging.
Link to work:
- See Code
- See OpenDNS API Documentation
Today's Progress:
- Simulating Real-World Processes With SimPy
Thoughts: Curious Subject I didn't heard of before reading this article from Real Python. Nice to have in the radar.
Link to work:
Today's Progress:
- Replace Conditional with Polymorphism
Thoughts: Reading Conditionals from the refactoring guru and playing with the example.
Link to work:
Today's Progress:
- ML Titanic with VSCode
Thoughts: Test VSCode Jupyter functionality
Link to work:
Today's Progress:
- Mocking with Python
Thoughts: Learn about db testing mocking with Python
Link to work:
Today's Progress:
- BDD with Python
Thoughts: I had some ideas about BDD and implementing it with Ansible. I also had some ideas about generating infrastructure with NLP or Gherkin. This is the first step and I will come back when playing with it some more time. Wanted also to start to understand how distributing software with Torrent as Facebook does. I want to understand the whole Torrent process so I just started decode torrent files.
Link to work:
- See Code
- See Test Automation with Python Behave and Ansible
- See Some Torrent information but not using this approach
- See Bitorrent Code
Today's Progress:
- azure_rm_privatednszone for Ansible
Thoughts: Development of a new module for Ansible Azure.
Link to work:
- See Code
Today's Progress:
- azure_rm_privatednszone_info for Ansible
Thoughts: Development of a new module for Ansible Azure.
Link to work:
- See Code
Today's Progress:
- Web scraping with Python
Thoughts: Easy web scrapping with BeautifulSoup
Link to work:
Today's Progress:
- Play with Toga
Thoughts: Toga is a Python native, OS native, cross platform GUI toolkit. Toga consists of a library of base components with a shared interface to simplify platform-agnostic GUI development.
Link to work:
- See Code
- See Toga Documentation
Today's Progress:
- Mocking External APIs in Python
Thoughts: How to test the use of an external API using Python mock objects. Run with nosetests --verbosity=2 mockingapi from the Python Directory
Link to work:
- See Code
- See Real Python Tutorial
Today's Progress:
- API Connection with Go
Thoughts: Learn how to GET and POST JSON with GO
Link to work:
- See Code
- See Consume RESTful API Endpoints
Today's Progress:
- API Client Certificates for Python
Thoughts: Learn and test possibilities loading client certificates in Python. It can be tested with:
Link to work:
- See Code