OSD600 Release 0.1 - DeadOrNot - CLI URL Checker

Release 0.1 Introduction 

For our first release in OSD600, we were tasked with creating a command line interface(CLI) that would take a file and parse its contents to find URLs and find out the http status of the URL. Once the program finds the status it will output the URLs with either Good, Bad or Unknown depending on the statuses that were found. To create my CLI, I decided to use python. I choose python because its a language I picked up recently and wanted some more practice on and also because I felt it offered many tools and resources that would make this program simple. 

GitHub Repo

https://github.com/AbdulMAbdi/deadOrNot

Usage and Features 

- calling the program with a file name or multiple file names will parse through the file(s) and find URLs and then output the links found along with whether its a live, dead or unknown link 

-  will output the results in colour, red for a bad link, yellow for an unknown link and green for a good link 

-makes use of multithreading to increase efficiency 

- option to only output dead links 

- option to only output live links 

-option to just output aggregate information about the URLs in the file ( how many dead, live and unknown links there are) 


Sample Images of Usage 

     python deadOrNot.py filename(s)

     python deadOrNot.py filename(s) -g

     python deadOrNot.py filename(s) -d
    
    python deadOrNot.py filename(s) -i











Comments

Post a Comment

Popular posts from this blog

Adding Features and Pull Request

Week 3 OSD600 - Pull Requests   This week, our class took a look at each other's release from the previous week and were tasked with finding an issue or suggesting an improvement/adding a feature and then implementing that fix or improvement in the from of a  pull request. This week I decided to once again took a look at Matt's CheckMyLinks python tool.  Finding Issues or Suggesting an Improvement While reviewing Matt's code, I couldn't really find any issues that I could fix, so I instead I decided to look for ways I could think of to improve his tool. I had a couple ideas but the one I decided to go with was to add an option that would allow the user to save the results of the link check to a text file. I thought this would be useful so the user can have a reference of the results after leaving the command line. I left an issue request on Matt's repo and began to implement the improvement.  Implementing Improvement   The first thing I did when starting to code t
Read more

Planning for Release 0.4

 For this final release I was able to find a project that has created a reddit bot that scans titles in reddit subreddits and if it matches the criteria laid out in the code it offers the poster some useful resources and/or some great projects to begin practicing coding. I thought this was a worthwhile project as this is something that would definitely be helpful to me and it seems like a great addition to the programming  community.  The specific issue that I wanted to work on was one were the creator of the bot had all the code for the bot basically in one python file and the file was growing to over 500 lines and he wanted to move to a more modular approach that would include separating out the logic into different files. I thought this would be a good issue to tackle because it would require me to get a full understanding of the code as well as add optimizations throughout while a separated out the code.  The approach I plan to take is first to review the code so I can get a more
Read more

Release 0.2 3rd Pull Request

Introduction For this pull request, I wanted to build the confidence to work with a larger open source project. I was able to find the perfect oppurtunity to build my confidence in working in larger more complex projects with Pandas. Pandas is a data analysis tool that I have used before with python and it was powerful and highly recommended so contributing to the project was something that really interested me.  Issue  The code base for pandas was pretty complex and intimidating so for my first contribution I wanted to find an issue that was fairly simple just so I could get a feel for the contributing process for such a larger project. I was able to find an issue that had been filed that was marked as good for first time contributors. The issue  was that they had several files that they wanted to move away from using dict() to create dictionaries and instead used python literal dicts to avoid having to ignore the flake8 errors they caused. Fixing this would be fairly simple so I pick
Read more