24 Popular Python Repositories

Popular Python Repositories

Check out these Popular Python Repositories to learn all about the cool things that are being developed with the Python programming language. The software we cover in this article includes httpie, flask, django, requests, ansible, scrapy, shadowsocks, tornado, scikit, reddit, ipython, sentry, docker compose, fabric, pyspider, salt stack, deis, boto, odoo, ajenti, and webpy. In looking at these popular Python repos, we can see that Python is used in applications like machine learning, big data, scientific analysis, IT and general automation, as well as web development.

1. Httpie

Httpie is an HTTP client operated entirely at the command line interface. It is user friendly and has nice features such as wget style downloads, syntax highlighting, json support, and a various useful extensions. You can use it to interact with HTTP servers, web services, and other API’s for easy debugging and testing. You make use of a simple http command and use the various HTTP verbs such as GET, POST, PUT, PATCH, and DELETE. source code

2. Awesome Python

A curated list of Python applications such as Environment Management, Package Repositories, Distribution, Build Tools, Text Processing, Natural Language Processing, Documentation, Configuration, Command-line Tools, Geolocation, HTTP, Database, Database Drivers, ORM, Web Frameworks, CMS, E-commerce, RESTful API, Serialization, Authentication, Template Engine, Queue, Search, Caching, Email, Internationalization, URL Manipulation, HTML Manipulation, Web Crawling, Web Content Extracting, Forms, Data Validation, and much more.

3. Flask

Flask is a framework written in Python with many powerful features built in. Flask uses a built in development server, has unit testing support built in, makes use of RESTful dispatching, uses the Jinja2 template system, uses secure cookies, is Unicode based, and has great documentation. source code

4. Django

Django is the web framework written in Python. It is used for rapid application development with the goal of reducing boilerplate one would encounter when starting a project from scratch. It is open source, fast, secure, and scales well. source code

5. Python Requests

Requests is a powerful HTTP library which allows the software engineer to send pristine HTTP/1.1 request with almost no effort. Rquests boasts features such as International Domains and URLs, Keep-Alive & Connection Pooling, Sessions with Cookie Persistence, Browser-style SSL Verification, Basic/Digest Authentication, Elegant Key/Value Cookies, Automatic Decompression, Automatic Content Decoding, Unicode Response Bodies, Multipart File Uploads, HTTP(S) Proxy Support, Connection Timeouts, Streaming Downloads, Chunked Requests and Thread-safety. source code

6. Ansible

Ansible is written in Python and is used to automate information technology such as application deployment, cloud provisioning, configuration management, as well as many other IT use cases. It is designed to monitor and automate the entire infrastructure, not just single systems at a time. source code

7. Scrapy

Scrapy is they Python powered application framework for crawling web sites and extracting data that can be used for many various useful applications such as data mining, information processing or historical archival. It is also excellent for data consumption of popular Application Programming Interfaces. source code

8. Certbot

Certbot is the Let’s Encrypt client which is a fully-featured, extensible client for the Let’s Encrypt Certificate Authority that can automate the tasks of obtaining certificates and configuring webservers to use them. The Let’s Encrypt client runs on Unix and Linux based operating systems. source code

9. Shadowsocks

Shadowsocks is a secure socks5 proxy which can be used to secure and protect sensitive Internet traffic. It is written in Python and offers flexible encryption, works on Windows, Linux, Mac, Android, and iOS, and is easy to install with the pip package manager. source code

10. Tornado

Tornado is a Python powered web framework as well as an asynchronous networking library. It was originally developed at friend feed which was later aquired by facebook. Tornado can scale to many thousands of open connections due to it’s non blocking input / output design which makes it good for WebSockets and other long polling type applications. source code

11. Scikit Learn

Scikit Learn is a machine learning framework built on the popular Python repositories NumPy, SciPy, and matplotlib. It is designed for data mining and analysis techniques such as Classification, Regression, Clustering, Dimensionality reduction, Model selection, and Preprocessing. source code

12. Reddit

Reddit brands itself as the front page of the internet, and they might not be far off on that description. It is one of the most heavily visited websites online today, and caters to a technically savvy and in the know community that uses a voting system to determine which news stories and links make it to the front page. source code

13. iPython

iPython is an enhanced interactive shell that surpasses the functionality offered by the default Python command line. iPython offers tab completion, system shell access, object introspection, command history retrieval across sessions, and an extended command system for adding functionality when working interactively. iPython strives to be a very efficient environment for both Python code development and for exploration of problems using Python objects. source code

14. Sentry

Sentry provides crash reporting for your web apps, mobile apps, and games in real time. It is used by companies such as dropbox, airnb, stripe, uber, and others. Although written in Python, Sentry works with most languages and frameworks such as React, Angular, Express, Django, Flask, Symfony, Laravel, Rails, Swift, and many more. source code

15. Python Design Patterns

This great collection of design patterns will help with learning the various approaches to software development in Python. The entire list is broken up into Creational Patterns, Structural Patterns, and Behavioral Patterns. This is a great educational resource for Python learners.

16. Docker Compose

Docker Compose was created to allow for the definition and running of multi container Docker applications. Compose uses a Compose config file which specifies all of the application services, then the software starts and runs everything for you with one command. The three step process has you create a Dockerfile, define services in docker-compose.yml, and then run docker-compose up. source code

17. Fabric

Fabric is a tool to streamline application deployment and system administration tasks, using the SSH protocol. The software offers a small collection of tools for remote and local shell commands, file management, as well as accepting user input or terminating program execution. source code

18. Pyspider

Pyspider is a web crawler written in Python. Just like Google and Bing use spiders to crawl and index website information, so too can you use Pyspider to complete similar tasks. It is built from several components such as the Scheduler, Fetcher, Processor, Result Worker, and WebUI. The webui is a very neat feature of Pyspider, as many other similar tools have no such functionality. source code

19. Salt

Salt is the Python powered Software which can automate, manage, and configure all types of applications and infrastructure at scale. Salt is used to manage all aspects of a data center or cloud infrastructure with support for virtualization, application stacks, and custom code. In fact SaltStack has been recognized by VMware as a winner of the award for virtualization management. Salt offers a platform for native configuration management for automation of critical CloudOps, ITOps and DevOps tasks. source code

20. Deis

Deis is an open source platform as a service for deploying and managing applications on your servers. It builds on Docker and Kubernetes to deliver a Heroku like workflow as a lightweight platform as a service. source code

21. Boto

Need to work programatically with Amazon Web Services? Boto is what you need if you’re working in Python. Boto is the AWS software development kit that makes it easy for Python developers to interact with Amazon services such as EC2 and S3. The api is object oriented, though direct service access is also built in. source code

22. Odoo

Odoo is open source customer relationship management software which supports such critical functions as ecommerce, sales, account, point of sale, project, and inventory. It may be open source, but Odoo competes with such heavyweights as Oracle, SAP, Salesforce, Quickbooks, and Trello. Odoo has over 5400 developers which has allowed the software to become polished and production ready. source code

23. Ajenti

Ajenti gives your servers a beautiful web based UI for system administration and monitoring. Ajenti is an alternative to software applications like cPanel, Plesk, and Webmin. source code

24. Webpy

Web.py is a Python framework for building powerful and scalable websites and applications. It was in use during early revisions of reddit and now powers sites such as Frinki, Yandex, Make History, Oyster.com, local.ch, archivd.com, Cheifmail, and pudung.com. source code