What Is Happening To The jQuery Plugins Site?
For about a week, instead of hosting several hundred jQuery plugins and several thousand advertisements for laptop batteries, our plugins repository has been serving up a pretty pathetic message about spam and an allusion to some “new submission process.” This happened very suddenly, and we’re sorry to everyone who’s been inconvenienced. Please allow me a few minutes to explain what happened, where we’re headed, and how it impacts you. If you’re in a rush, here’s the short version.
The Backstory
Though the plugins site you’ve known and loved was a valuable tool when it was first set up, it gradually became something of a white elephant for the project. While powerful distribution tools like GitHub and npm have come to the fore, we’ve been stuck in an aging, CMS-oriented paradigm that frustrated developers and consumers of plugins alike. Many people moved onto alternative sources for finding and vetting plugins. Furthermore, the sites’s original implementors and maintainers had since moved on from active involvement within the jQuery project. While the team faced a steady stream of complaints about usability and a general lack of features, the site itself faced a veritable barrage of (several flavors of) spam. There was your standard, keyword-rich SEO garbage, but there was also something slightly more insidious: the batch posting of under-documented, demo-free plugins with links to paid download sites by third parties trawling for affiliate cash. While this wasn’t explcitly disallowed, it led to a terrible, confusing experience for users and gave the site the distinct sense that all was not on the up and up.
The Best Laid Plans…
Sensitive to all these problems, the team began drawing up requirements for a complete overhaul. We knew we wanted to get out of the business of accepting uploads, serving downloads, and generally legislating the plugin “release” process on our own servers. With our official projects already on GitHub, we knew we wanted to leverage the many wheels they’d already invented for distribution, versioning, and facilitating open, collaborative development. Another requirement was to create a standard schema for authors to clearly delineate dependencies, like which version(s) of jQuery a plugin supports, as well as other plugins and CSS assets it requires to be functional. We also wanted to introduce some quality control, with both passive mechanisms like requiring GitHub and a manifest file for distribution, as well as active ones like user ratings. Finally, we wanted a clean slate; with stricter requirements for submission, there could be no mass import of all the old plugins. We made a lot of progress preparing specifications, but hampered by a lack of resources and a number of other projects, we never were able to get too deep into the implementation phase. After all, the old site “worked!”
…Often Go Awry
As the glut of spam grew worse and multiple reports started showing up on the jQuery Core bug tracker, I wanted to at least take some steps to wipe a bit of the spam and egg off our face. With newly provisioned access to the administrative tools on the site, I teamed up with the Drupal Views Bulk Operations module and set out to identify and delete spammers and their posts. Within a day or two, nearly 90% of the alleged “content” was gone from the site. I continued to monitor the situation over the ensuing days, and deleted spam as it came in. Unfortunately, I likely cast too wide of a net, and threw out several perfectly good babies with the bathwater. Even more unfortunately, I didn’t back up the database before I began this process. At this point, you can probably see where this story is headed. Later in the week, while I was attempting to delete four spam items, I was left completely horrified when the results of the operation reported that the remaining 10% — every single plugin remaining in the database — had been purged. All that remained was a year-old backup. Of course, I realize that this is a dreadful outcome, and I take full responsibility for it. If it helps, I am very receptive to hate mail and tweets reprimanding me for being irresponsible, unprofessional, or just stupid.
At this juncture, we were left with two choices.
- Keep on kicking the can down the road: Restore from the old backup, losing a lot of data anyway, and have authors go through the painstaking process of re-uploading their plugins, even though the site was slated to be deprecated entirely anyway.
- Use this glaring mistake as the impetus to hunker down, cleave from the past, and finally implement the site we’ve talked about for so long.
We’ve chosen the latter.
Nuts And Bolts
Over the past few days, we’ve started converting our plans into action, building out an infrastructure that’s backed by GitHub. There are two requirements for listing a plugin on the new site:
- A valid package.json file
We’ve followed the lead of CommonJS and npm and created a schema for specifying dependencies, delivery, and other metadata of jQuery plugins. While the format is largely similar to those other projects, we’ve had to make some minor tweaks to account for some plugin-specific details. - At least one versioned release
This means having tagged your release point(s) with a valid semantic version number (semver) string.
We’ve pared down the submission and maintenance process to a single, one-time step: adding a post-receive hook to your plugin’s GitHub repository. Assuming your plugin meets the guidelines, a page will be created on the plugins site to present your usage and download information. We’ll keep track of new releases as you push them.
In The Interim
We recognize that the old site was still serving as an regular resource for a lot of people, especially newer jQuery users, who simply valued the existence of a central browsing location, despite its flaws. Though many experienced users had moved on to other sites, or relied on relationships with trusted authors and word of mouth, these can take time to develop. Until we’re able to launch the new system, we’re happy to direct you to several other directories and people who can help pick up the slack:
If, in the process of searching these or any other directories, you are directed back to the current site at plugins.jquery.com, typically a quick search for the author’s name and the plugin name will yield an alternative site where it was hosted. In addition, DailyJS just did a useful roundup of alternatives that goes into more detail.
Next Steps For Plugin Authors
If you’re a plugin developer who wants to make sure your plugins will be ready to go on day one (or even beforehand), you’ll want to make sure your plugins are up on GitHub, and then you’ll want to get started on creating your package.json files and making sure your versions are appropriately tagged. If you aren’t already familiar with Git and GitHub, then this is probably a very good time for you to take the plunge and get started. If you prefer another SCM system, you can look into setting up a mirror to git from svn or hg, or other project hosting sites, like bitbucket or gitorious. If you don’t develop your plugins as open source, or you don’t use any source control at all, we will not be able to accomodate you at this time.
How Can I Help?
Though the site is still a work in progress, you can track progress and even set up your own local development right now at github.com/jquery/plugins.jquery.com/. We’re still working on getting a public staging environment together.
Though the site is essentially “powered by” GitHub, there are obviously a number of moving parts in play. The site will actually be served from inside of WordPress, which is populated with the contents of the indexed plugins using a node.js tool. There are still many kinks to be ironed out, so if that sounds like a stack you want to jump on, please join us over at the repo. We’ll be using GitHub Issues for all feature requests, bugs, and discussion.
While we’ve put a great deal of thought into putting together our package.json schema, it’s still a living document, and if you have questions or comments on why it is the way that it is, head on over to this issue.
Errata
In an ideal world, this certainly wouldn’t have happened exactly as it did. Sadly, it did. We hope you’ll accept our apologies for the many ways this transition might make your job harder, give you some extra work you weren’t expecting, or just plain leave a bad taste in your mouth. If you are able to forgive us, bear with us, and maybe even lend a hand, we’re confident we’ll be able to deliver the modern, useful plugins site the community deserves.
TL;DR
So that was a lot of words, here’s the takeaway.
- We’d been planning on replacing the original, spam-ridden plugin site for quite some time
- In the process of deleting on the spam, all the plugins were deleted and we didn’t have a recent backup
- Instead of burning cycles keeping the old site on life support, we decided to make a clean break and kick development on the new site into high gear.
- The new site is powered by GitHub and a package manifest for plugins
- Plugins from the old site were never going to be automatically imported into the new one.
- The repo is at github.com/jquery/plugins.jquery.com
- We are very sorry, but also very excited!
does anybody know when this new plugins website will be up and running? any projected date or anything?
thanks,
George
I have exactly the same question
Love jquery! I avoided learning javascript like the plague until I discovered it.
Great to get an honest explanation as to what’s going on here, and as another user commented, we’ve all been there and it is more often than not a blessing in disguise.
Keep up the awesome work guys!
I’m going to echo some of the recent comments – do you have a timeline for the new plugins site? I’m excited to see it, or at least a rough version of it. Given the holidays this time of year, no big rush, but just wondering about the schedule.
Happy holidays, and thanks for all of your hard work!
I am glad you deleted all of them. The good ones will come back right away, and the dated/not-so-great plugins will be where they belong :)
Excited to see the new system. Thanks for all you do!
i m exicted to see new plugin….wen r u going to launch…
okguys no pannic.. use googlecache to find the files you need, just search for the txt file by adding cache: in front of the url
example:
cache:http://plugins.jquery.com/files/jquery.autoanchors-0.3.js.txt
Works perfectly!
search cache via google:
cache:URL or Cached link
Estimate from yesterday to 3 months old. Crawl date given. Text only cache as well.
The JqTransform (http://www.dfc-e.com/metiers/multimedia/opensource/jqtransform/) don’t work if i’m using anywhere slider. Help!
I tried to add http://www.phunkei.de/blog/2-autostorage-js but listing new plugins is not available yet.
Very well done,
9 of 10 people would have kept the old crap. I guess you accidentally deleted all of it, but eventually JQuery will grow just because of this renaissance.
100 points for preventing us to use shitplugins!
It could NOT have happened to anyone :) That aside, hope to see it revived soon!
I once “accidentally” overridden clients old site with a new one without backup as a first demo. Boss chewed me out for a bit, but the client was happy with the new site and didn’t mind. Similar situation here as I understand it ;)
I’d go on and say it was a good turn whether accidental or not, but I’d make sense to see the new plugins site up and running.
So about this post-receive hook… I am assuming I just add a URL to your plug-ins hook? I didn’t see a published URL for this.
The fact that you’re so open and honest about what happened says a lot. You could have so easily spun that and made it NOT your fault but you took it full brunt. You’re human, we do make mistakes. I love what you guys have done here. jQuery, the plugins, the UI components all of it is just killer and I thank you for it. Don’t fret too much about it, as the end result will be much better! I so understand how much it sucks to lose a database that is extremely important, I’ve been there myself. I bet if nothing else you ALWAYS backup you DB first! :)
No todas las cosas son malas, podriamos juzgar pero ustedes hicieron lo correcto al pedir disculpas, yo creo que query puede dar mucho mas que solamente esto, espero mas y muy bien por su actitud
I recently deleted a site ‘accidentally’ Being lazy and using C-Panel I selected the wrong site – should have been a temp site setup for testing…
At least there was a current backup database and files – only had to upload the files, restore the database, and replace a few images.
Good luck with the new site – it’s looking great
Good! The plugins search was horrible on the old site. I had to go through google to find anything relevant. Don’t hate on Drupal it is what you want it to be, but you have to use the correct tool for the job.
The old site wasn’t perfect but it did give developers a central point to show off their creations and for users to see what new features have been produced. The Battery ads were a pain but not as frustrating as the search feature BUT it was still the only way to sift through all these to find the gem you needed.
Any idea when something similar (the listing not the Battery Ads) will be back on-line again?
Having no plugin archive is hurting jQuery. Any ETA?
I would have loved it if the new system was build / implemented beside the old one. Many plugins are only published in the old system. This is really starting to hurt…
Yes, we are waiting for too long, jQuery community is getting impatient…
Instead of presenting the old site as a dead archive, why not put it up as the real thing while creating something new?
Linking to a spare-time Github project and a blog post explaining a screwup isn’t helping anyone.
dfl, I really hope, for your company’s good, that you’re a programmer and not a team manager.
We are really looking forward to the jQuery plugins website !!
Hey Adam and whole team, thanks for the explanation. Crisis are global and there is no one to claim being perfect! after all we all are human.
Keep up the good work!
The plugins are the life-blood of jQuery presenting the latest developments in the product. They keep user interest at a high level and allow developers to implement often complex procedures much more easily.
While the new site may be wonderful, something is needed now so that us web-site developers can continue to provide our organisations with product. If jQuery is continue to be taken seriously in a professional world it can’t just say “No product for the time being” with no interim arrangements or target date for completion.
I’m sure you are all working hard and will come up with something that is much better than before – but – we do need something in the meantime (ie now) – please – please – please !
I just hope that you will be removed from the jQuery team!! A fuckup like this on any company would get the guy who did it FIRED!!!
When the hell will the plugin site be back up.
this is really upsetting.
@YouShouldBeFired – this is why no one ever heard about your little shitty company if it represents attitude like yours.
Mistakes happen. Those who are serious about jQuery are happy about the changes.
@santo Im serious about jQuery, and I am not happy to keep on waiting for several months until the new website is ready. I understand that it was a mistake, and I really hope that no one will get fired, but it is being too long, dont you think so?
jQuery is such an important resource nowadays, that two months wainting for the plugins repository I think can hurt jQuery itself. Maybe more resources should be used in order to speed up the website development.
Im sure the new website will rock and will be much better, but I really hope to see it soon!! :-)
This is really bad. All over the web links are broken for jQuery plugins. I can’t wait any longer. This really sucks for project development.
Better yet, make the link to http://archive.plugins.jquery.com/ more prominent.
Has this project been abandoned?
Your honest answer sound interesting, it proves everyone makes mistake and it is good to accept it instead of giving bunch of explanation.
Best of luck for your new site, will always love jquery.
While this is an entertaining story, it shows the general lack of professionalism encountered in every aspect of the “Open Source World”.
Why should I use a framework whose maintainers are too inexperienced to even have rotating backups for their servers?
That last comment made me sick. This is not about “Open Source World”, this is about being human.
Every human being makes mistakes. As great as jQuery is, you cannot build perfect solutions. The most important is to keep improving to make it as good as possible.
And more important, keep us informed, so the community can grow up as well !
jQuery is an excellent product and is well supported by a dedicated group of individuals. Someone made a mistake – not nice but we have to live with it and move on.
The plugins are what makes this product great – If they didn’t exist it would be a less useful product. It is amazing to have a wealth of powerful, compact and tested appliactions. Except that at the moment we don’t have access to that set of applications. What’s more we don’t have a date for when we might have them…
If someone is working on this can we have a probable end-date, please?
I’m totally agree with last comment !!! jQuery is great and has helped a LOT of developers in building a LOT great web pages !
As for this particular plugin page issue, it really stopped a lot of us to further explore the ability of jQuery. Months has passed and yet there’s no news/updates for how long more to wait.
Lastly, personally I really appreciate the efforts of creators to create jQuery.
Come on people,
do you pay these guys to develop jQuery for you? I guess not so stop complaining.
Given how bad was the plugin site (outdated junk, script kiddies junk and spam spam spam) I think it was a blessing that someone came and rm -rf’d it. Seriously.
jQuery is ubb3r and deserves a l33t plugin archive.
And stop pressing for the new site! Those guys have a life you know? If you want to speedup the result go a fund them.
It sounds as if you didn’t value the Plugins site that much Bruno! The rest of us did (even if there were spam items and out-of-date items one could with little trouble skip over them) and used it extensively. The attitude that `its not there, so what?` must be very demotivating for the developers, although not as obnoxious as the `sack them all` brigade!
My feelings are:
(1) It is are that it is an integral part of jQuery. Not having a plugin site lessens the value of jQuery itself.
(2) I’d like it back on-line ASAP
(3) But above all keep us informed of what’s happening and when a new one will be available.
Reply to jQuery Rocks:
I certainly didn’t mean to come across in anyway critical to the jquery teams! We are lucky to have a dedicated and talented teaming working for the user community. It is just that it is frustrating to have no way (for a considerable period) for the users to contribute their applications, based on jQuery, and for the rest of us to be made aware of the options out there. Otherwise we are re-inventing wheels the whole time.
I think if we know what was happening and when the plans were to deliver an alternative (or just reinstate the old system for a while) then we would all feel better. As you say a date for UI 1.9 would be of interest too!
I wasn’t really referring to your posts, Bill – I was mostly talking about others’ comments that the jQuery team should be fired, and where people were swearing, calling the author of the article various things, etc.
Hey! We really miss the Plugin site. Can you mail us about the progress?
Reply to jQuery Rocks
That’s a relief – Though I’d caused offence – I am a jQuery fan too.
I do rely a lot on jQuery plugins (and some of my own coding) to make my websites memorable. Without the PlugIns site I’m struggling to reInvent the wheel and my productivity has fallen off a cliff.
I do agree that abuse and calling people names is never the right solution, and also counter-productive as I’m sure it will demotivate the talented group who provide this excellent resource.
I am using Jquery Idle timeout plugin it’s working fine for aspx pages but it’s not working for fancybox modalpopup. when i clickon OK to continue from fancybox modalpopup then my session is expiring and going to logoff page. Does anybody has idea about this?
In the past I have found JQuery plugin site extremely useful. The only time the excuse regarding ‘several thousand advertisements for laptop batteries’ came up was following the discovery that no one had actually backed up irreplaceable data. All concerned should have a career rethink and leave this kind of stuff to experts.
P.S. Just how long is this going to take to clear up? First post appeared on 8th December 2011.
Oh I miss the old plugin site!
Through this experience you’ll never forgot to make a backup, I think.
Good luck for the new site! Could you crate an email reminder for people who want to use this site as fast as one can?
I think that’s the kind of thing you only learn the hard way. Most engineers out there will probably relate to this :-)
Anyways, the important thing is when will the new site be up ? The old site probably had its problems, but having nothing to work with is worse.