[Django]-Is Python good enough for big applications?

Google tend to use python for a lot, so I assume its ready for big time. We use python as glue for our products so we’re happy with it.

The back end of YouTube is almost entirely in Python. Here is a talk by Cuong Do Cuong, the engineering manager on the YouTube scalability team that goes into a lot of detail of the issues they faced and how they solved them. He points out that lanaguage speed is almost never a bottleneck.

I suspect that YouTube has a significantly higher load that whatever you are working on will.

The answer to your question really boils down to what you have in mind when you say “big application”. The simple answer will be “yes”. Python serves as the backbone for incredibly complex systems and it does so elegantly (just take a look at how large yet well designed Twisted & Django are). However, it’s a tool like any other. It contains performance tradeoffs that may or may not be well suited to your application domain.

If you’re looking to build a high-performance flight simulator that must run complex calculations at over 1000Hz… then Python probably isn’t the right choice for the whole project. If, on the other hand, single-CPU performance isn’t a predominant factor or the application will be spread out over multiple servers to achieve scalability requirements, Python will likely be a good choice.

It’s amazing how easily people forget just how expensive development time is. Python is well known for the incredible speed with which production quality applications can be developed. For almost anything non trivial, the development time saved will far outweigh the cost associated with tossing a few extra servers into the pool.

In general, yes you can.

I am mainly focused on the web development so for examples I can give Stack Overflow, Facebook, Amazon etc.

Reddit.com is written in Python. It has a large user base and receives a fair amount of traffic and seems to be doing well. Reddit doesn’t use Django though.

Python is ideal for web development. It’s light, easy, and excels at gluing other bits together, and working with high level interfaces. If and when I do “web” development, I wouldn’t use anything else.

Update0

It’s also a superior language for scripting, small cross platform applications and prototyping. It only really starts to crumble when extreme performance requirements are stringent. That is, it’s holding things up in a big way. I also find it’s difficult to refactor (a property of dynamic typing), and to utilize platform specific bindings. These things can be worked around (quite easily, due to Python’s C implementation, and numerous modules for this purpose), just as in most other good languages.

Python is the best high level language, the only language it can’t replace is C.

See by yourself :

http://en.wikipedia.org/wiki/List_of_Python_software

I think it can handle big apps.

There two very important factors with python:

1) Easy to use

2) Easy to interface with other programming languages

FACTOR 1

Because python a language that emphasizes , simplicity , readability of code both for its own syntax and libraries, that equal to writing less code. And for software that is big this is very important. Your is simple, easier to understand by someone else, easier to debug , easier to recode , rewrite and modify. Easy to exchange between a team of many people.

FACTOR 2

Why reinvent that wheel ? You want to use a C/C++ library ? How about a Java or .NET library ? Python will let you do exactly that and will even spoil you with allowing you to enjoy the experience without ever leaving python’s syntax comfort zone. Jython, Ironpython, Cython, ctypes ,pyrex etc are excellent tools making python limitless with its capabilities let you code in all those diffirent languages/frameworks/runtimes always with python syntax. What more could you ask for ?

In the end its python flexibility that makes it accelerate in the gain of its popularity, always hand in hand with the ease of use . Power and ease of use is a huge temptation too hard to resist for small,big or huge developers alike.

I’m going to answer your revised question about why would anyone use a different language or technology stack. First, I love Python. Great language and definitely has its merits. However, I choose C#/.NET as my technology of choice and use Python for scripting.

Yes, Python as a language is very simple/clean and there isn’t compile time. However, I find it many times easier to work with a strongly/statically typed language. #1 reason is IntelliSense (and I mean GOOD IntelliSense – haven’t been satisfied with Python editors in this regard). IntelliSense makes a huge difference in ease/speed of development.

C# is backed by Microsoft (for better or worse). While the h8t3rs out there can throw rocks, it is hard to deny that Microsoft has technology for the entire stack (desktop, server, web, mobile, etc.) and it all integrates very nicely. I also know that it is supported by hundreds of developers who are dedicated to providing the best experience possible. I also can go to a plethora of sites and watch videos, read articles, and find what I need for just about anything. Support is nice.

I know Python has an excellent (and large) range of libraries and frameworks at its disposal, but I have also felt a certain lack of continuity between the various projects. Use this 3rd-party library here, throw this 3rd party library in there, use this open source project here…And while I love open source, it takes a much longer time to reach the quality in which Microsoft has put out.

Lastly, Visual Studio is one of the most excellent IDE’s I’ve ever experienced. I know there are many fine text editors out there (I love you VIM!), but it is hard to beat the integration of source control, code editing, compiling, building, publishing, testing, and deploying all wrapped into a most excellent package.

All this to say, Python is great and can perform wonderfully on large sites – don’t get me confused. However, there are valid arguments for using enterprise technologies. It just depends on what resources you (or your team) will need, what you are already familiar with, and how you plan to scale when your application is successful. If you are comfortable with the technology and libraries, have a community to answer tough questions, and can compartmentalize your code so that if you ever do need to re-write it, it is already broken up, then I say you will do just fine.

Performance wise – Yes, certainly for web frontends. The performance bottleneck is always the database.

In fact, Python give you all of the best power of programming. Easy, powerful and quick!
Enjoy it in big your projoect!

See https://stackoverflow.com/questions/1906795/what-are-some-famous-websites-built-in-django for examples of how Python (in this case Django) can handle heavy load.

Disqus, Pinterest, Pownce and Instagram all handle hundreds of requests per second, millions of users etc.