fbpx
Wikipedia

Usenet

Usenet (/ˈjznɛt/) is a worldwide distributed discussion system available on computers. It was developed from the general-purpose Unix-to-Unix Copy (UUCP) dial-up network architecture. Tom Truscott and Jim Ellis conceived the idea in 1979, and it was established in 1980.[1] Users read and post messages (called articles or posts, and collectively termed news) to one or more topic categories, known as newsgroups. Usenet resembles a bulletin board system (BBS) in many respects and is the precursor to the Internet forums that have become widely used. Discussions are threaded, as with web forums and BBSs, though posts are stored on the server sequentially.[2][3]

A diagram of Usenet servers and clients. The coloured dots on the servers represent the newsgroups they carry. Coloured arrows between servers indicate newsgroup content exchanges (news feeds). Arrows between clients and servers indicate that a user is subscribed to a certain newsgroup and reads or submits articles there.

Notably, clients never connect with each other, but still have access to each other's posts even when they also never connect to the same server.

A major difference between a BBS or web message board and Usenet is the absence of a central server and dedicated administrator or hosting provider. Usenet is distributed among a large, constantly changing set of news servers that store and forward messages to one another via "news feeds". Individual users may read messages from and post to a local (or simply preferred) news server, which can be operated by anyone, and those posts will automatically be forwarded to any other news servers peered with the local one, while the local server will receive any news its peers have that it currently lacks. This results in the automatic proliferation of content posted by any user on any server to any other user subscribed to the same newsgroups on other servers.

As with BBSs and message boards, individual news servers or service providers are under no obligation to carry any specific content, and may refuse to do so for many reasons: a news server might attempt to control the spread of spam by refusing to accept or forward any posts that trigger spam filters, or a server without high-capacity data storage may refuse to carry any newsgroups used primarily for file sharing, limiting itself to discussion-oriented groups. However, unlike BBSs and web forums, the dispersed nature of Usenet usually permits users who are interested in receiving some content to access it simply by choosing to connect to news servers that carry the feeds they want.

Usenet is culturally and historically significant in the networked world, having given rise to, or popularized, many widely recognized concepts and terms such as "FAQ," "flame," "sockpuppet," and "spam."[4] In the early 1990s, shortly before access to the Internet became commonly affordable, Usenet connections via Fidonet's dial-up BBS networks made long-distance or worldwide discussions and other communication widespread, not needing a server, just (local) telephone service.[5]

The name Usenet comes from the term "users' network".[2] The first Usenet group was NET.general, which quickly became net.general.[6] The first commercial spam on Usenet was from immigration attorneys Canter and Siegel advertising green card services.[6]

On the Internet, Usenet is transported via the Network News Transfer Protocol (NNTP) on TCP Port 119 for standard, unprotected connections and on TCP port 563 for SSL encrypted connections.

Introduction

Usenet was conceived in 1979 and publicly established in 1980, at the University of North Carolina at Chapel Hill and Duke University,[7][1] over a decade before the World Wide Web went online (and thus before the general public received access to the Internet), making it one of the oldest computer network communications systems still in widespread use. It was originally built on the "poor man's ARPANET", employing UUCP as its transport protocol to offer mail and file transfers, as well as announcements through the newly developed news software such as A News. The name "Usenet" emphasizes its creators' hope that the USENIX organization would take an active role in its operation.[8]

The articles that users post to Usenet are organized into topical categories known as newsgroups, which are themselves logically organized into hierarchies of subjects. For instance, sci.math and sci.physics are within the sci.* hierarchy. Or, talk.origins and talk.atheism are in the talk.* hierarchy. When a user subscribes to a newsgroup, the news client software keeps track of which articles that user has read.[9]

In most newsgroups, the majority of the articles are responses to some other article. The set of articles that can be traced to one single non-reply article is called a thread. Most modern newsreaders display the articles arranged into threads and subthreads. For example, in the wine-making newsgroup rec.crafts.winemaking, someone might start a thread called; "What's the best yeast?" and that thread or conversation might grow into dozens of replies long, by perhaps six or eight different authors. Over several days, that conversation about different wine yeasts might branch into several sub-threads in a tree-like form.

When a user posts an article, it is initially only available on that user's news server. Each news server talks to one or more other servers (its "newsfeeds") and exchanges articles with them. In this fashion, the article is copied from server to server and should eventually reach every server in the network. The later peer-to-peer networks operate on a similar principle, but for Usenet it is normally the sender, rather than the receiver, who initiates transfers. Usenet was designed under conditions when networks were much slower and not always available. Many sites on the original Usenet network would connect only once or twice a day to batch-transfer messages in and out.[10] This is largely because the POTS network was typically used for transfers, and phone charges were lower at night.

The format and transmission of Usenet articles is similar to that of Internet e-mail messages. The difference between the two is that Usenet articles can be read by any user whose news server carries the group to which the message was posted, as opposed to email messages, which have one or more specific recipients.[11]

Today, Usenet has diminished in importance with respect to Internet forums, blogs, mailing lists and social media. Usenet differs from such media in several ways: Usenet requires no personal registration with the group concerned; information need not be stored on a remote server; archives are always available; and reading the messages does not require a mail or web client, but a news client. However, it is now possible to read and participate in Usenet newsgroups to a large degree using ordinary web browsers since most newsgroups are now copied to several web sites.[12] The groups in alt.binaries are still widely used for data transfer.

ISPs, news servers, and newsfeeds

 
Usenet Provider Map

Many Internet service providers, and many other Internet sites, operate news servers for their users to access. ISPs that do not operate their own servers directly will often offer their users an account from another provider that specifically operates newsfeeds. In early news implementations, the server and newsreader were a single program suite, running on the same system. Today, one uses separate newsreader client software, a program that resembles an email client but accesses Usenet servers instead.[13]

Not all ISPs run news servers. A news server is one of the most difficult Internet services to administer because of the large amount of data involved, small customer base (compared to mainstream Internet service), and a disproportionately high volume of customer support incidents (frequently complaining of missing news articles). Some ISPs outsource news operations to specialist sites, which will usually appear to a user as though the ISP itself runs the server. Many of these sites carry a restricted newsfeed, with a limited number of newsgroups. Commonly omitted from such a newsfeed are foreign-language newsgroups and the alt.binaries hierarchy which largely carries software, music, videos and images, and accounts for over 99 percent of article data.

There are also Usenet providers that offer a full unrestricted service to users whose ISPs do not carry news, or that carry a restricted feed.

Newsreaders

Newsgroups are typically accessed with newsreaders: applications that allow users to read and reply to postings in newsgroups. These applications act as clients to one or more news servers. Historically, Usenet was associated with the Unix operating system developed at AT&T, but newsreaders were soon available for all major operating systems.[14] Email client programs and Internet suites of the late 1990s and 2000s often included an integrated newsreader. Newsgroup enthusiasts often criticized these as inferior to standalone newsreaders that made correct use of Usenet protocols, standards and conventions.[15]

With the rise of the World Wide Web (WWW), web front-ends (web2news) have become more common. Web front ends have lowered the technical entry barrier requirements to that of one application and no Usenet NNTP server account. There are numerous websites now offering web based gateways to Usenet groups, although some people have begun filtering messages made by some of the web interfaces for one reason or another.[16][17] Google Groups[18] is one such web based front end and some web browsers can access Google Groups via news: protocol links directly.[19]

Moderated and unmoderated newsgroups

A minority of newsgroups are moderated, meaning that messages submitted by readers are not distributed directly to Usenet, but instead are emailed to the moderators of the newsgroup for approval. The moderator is to receive submitted articles, review them, and inject approved articles so that they can be properly propagated worldwide. Articles approved by a moderator must bear the Approved: header line. Moderators ensure that the messages that readers see in the newsgroup conform to the charter of the newsgroup, though they are not required to follow any such rules or guidelines.[20] Typically, moderators are appointed in the proposal for the newsgroup, and changes of moderators follow a succession plan.[21]

Historically, a mod.* hierarchy existed before Usenet reorganization.[22] Now, moderated newsgroups may appear in any hierarchy, typically with .moderated added to the group name.

Usenet newsgroups in the Big-8 hierarchy are created by proposals called a Request for Discussion, or RFD. The RFD is required to have the following information: newsgroup name, checkgroups file entry, and moderated or unmoderated status. If the group is to be moderated, then at least one moderator with a valid email address must be provided. Other information which is beneficial but not required includes: a charter, a rationale, and a moderation policy if the group is to be moderated.[23] Discussion of the new newsgroup proposal follows, and is finished with the members of the Big-8 Management Board making the decision, by vote, to either approve or disapprove the new newsgroup.

Unmoderated newsgroups form the majority of Usenet newsgroups, and messages submitted by readers for unmoderated newsgroups are immediately propagated for everyone to see. Minimal editorial content filtering vs propagation speed form one crux of the Usenet community. One little cited defense of propagation is canceling a propagated message, but few Usenet users use this command and some news readers do not offer cancellation commands, in part because article storage expires in relatively short order anyway. Almost all unmoderated Usenet groups tend to receive large amounts of spam.[24][25][26]

Technical details

Usenet is a set of protocols for generating, storing and retrieving news "articles" (which resemble Internet mail messages) and for exchanging them among a readership which is potentially widely distributed. These protocols most commonly use a flooding algorithm which propagates copies throughout a network of participating servers. Whenever a message reaches a server, that server forwards the message to all its network neighbors that haven't yet seen the article. Only one copy of a message is stored per server, and each server makes it available on demand to the (typically local) readers able to access that server. The collection of Usenet servers has thus a certain peer-to-peer character in that they share resources by exchanging them, the granularity of exchange however is on a different scale than a modern peer-to-peer system and this characteristic excludes the actual users of the system who connect to the news servers with a typical client-server application, much like an email reader.

RFC 850 was the first formal specification of the messages exchanged by Usenet servers. It was superseded by RFC 1036 and subsequently by RFC 5536 and RFC 5537.

In cases where unsuitable content has been posted, Usenet has support for automated removal of a posting from the whole network by creating a cancel message, although due to a lack of authentication and resultant abuse, this capability is frequently disabled. Copyright holders may still request the manual deletion of infringing material using the provisions of World Intellectual Property Organization treaty implementations, such as the United States Online Copyright Infringement Liability Limitation Act, but this would require giving notice to each individual news server administrator.

On the Internet, Usenet is transported via the Network News Transfer Protocol (NNTP) on TCP Port 119 for standard, unprotected connections and on TCP port 563 for SSL encrypted connections.

Organization

 
The "Big Nine" hierarchies of Usenet

The major set of worldwide newsgroups is contained within nine hierarchies, eight of which are operated under consensual guidelines that govern their administration and naming. The current Big Eight are:

  • comp.* – computer-related discussions (comp.software, comp.sys.amiga)
  • humanities.*fine arts, literature, and philosophy (humanities.classics, humanities.design.misc)
  • misc.* – miscellaneous topics (misc.education, misc.forsale, misc.kids)
  • news.* – discussions and announcements about news (meaning Usenet, not current events) (news.groups, news.admin)
  • rec.* – recreation and entertainment (rec.music, rec.arts.movies)
  • sci.* – science related discussions (sci.psychology, sci.research)
  • soc.* – social discussions (soc.college.org, soc.culture.african)
  • talk.* – talk about various controversial topics (talk.religion, talk.politics, talk.origins)

See also the Great Renaming.

The alt.* hierarchy is not subject to the procedures controlling groups in the Big Eight, and it is as a result less organized. Groups in the alt.* hierarchy tend to be more specialized or specific—for example, there might be a newsgroup under the Big Eight which contains discussions about children's books, but a group in the alt hierarchy may be dedicated to one specific author of children's books. Binaries are posted in alt.binaries.*, making it the largest of all the hierarchies.

Many other hierarchies of newsgroups are distributed alongside these. Regional and language-specific hierarchies such as japan.*, malta.* and ne.* serve specific countries and regions such as Japan, Malta and New England. Companies and projects administer their own hierarchies to discuss their products and offer community technical support, such as the historical gnu.* hierarchy from the Free Software Foundation. Microsoft closed its newsserver in June 2010, providing support for its products over forums now.[27] Some users prefer to use the term "Usenet" to refer only to the Big Eight hierarchies; others include alt.* as well. The more general term "netnews" incorporates the entire medium, including private organizational news systems.

Informal sub-hierarchy conventions also exist. *.answers are typically moderated cross-post groups for FAQs. An FAQ would be posted within one group and a cross post to the *.answers group at the head of the hierarchy seen by some as a refining of information in that news group. Some subgroups are recursive—to the point of some silliness in alt.*[citation needed].

Binary content

 
A visual example of the many complex steps required to prepare data to be uploaded to Usenet newsgroups. These steps must be done again in reverse to download data from Usenet.

Usenet was originally created to distribute text content encoded in the 7-bit ASCII character set. With the help of programs that encode 8-bit values into ASCII, it became practical to distribute binary files as content. Binary posts, due to their size and often-dubious copyright status, were in time restricted to specific newsgroups, making it easier for administrators to allow or disallow the traffic.

The oldest widely used encoding method for binary content is uuencode, from the Unix UUCP package. In the late 1980s, Usenet articles were often limited to 60,000 characters, and larger hard limits exist today. Files are therefore commonly split into sections that require reassembly by the reader.

With the header extensions and the Base64 and Quoted-Printable MIME encodings, there was a new generation of binary transport. In practice, MIME has seen increased adoption in text messages, but it is avoided for most binary attachments. Some operating systems with metadata attached to files use specialized encoding formats. For Mac OS, both BinHex and special MIME types are used. Other lesser known encoding systems that may have been used at one time were BTOA, XX encoding, BOO, and USR encoding.

In an attempt to reduce file transfer times, an informal file encoding known as yEnc was introduced in 2001. It achieves about a 30% reduction in data transferred by assuming that most 8-bit characters can safely be transferred across the network without first encoding into the 7-bit ASCII space. The most common method of uploading large binary posts to Usenet is to convert the files into RAR archives and create Parchive files for them. Parity files are used to recreate missing data when not every part of the files reaches a server.

Binary retention time

 
October 2020 screenshot showing 60 PB of usenet group data.[28]

Each news server allocates a certain amount of storage space for content in each newsgroup. When this storage has been filled, each time a new post arrives, old posts are deleted to make room for the new content. If the network bandwidth available to a server is high but the storage allocation is small, it is possible for a huge flood of incoming content to overflow the allocation and push out everything that was in the group before it. The average length of time that posts are able to stay on the server before being deleted is commonly called the retention time.

Binary newsgroups are only able to function reliably if there is sufficient storage allocated to handle the amount of articles being added. Without sufficient retention time, a reader will be unable to download all parts of the binary before it is flushed out of the group's storage allocation. This was at one time how posting undesired content was countered; the newsgroup would be flooded with random garbage data posts, of sufficient quantity to push out all the content to be suppressed. This has been compensated by service providers allocating enough storage to retain everything posted each day, including spam floods, without deleting anything.

Modern Usenet news servers have enough capacity to archive years of binary content even when flooded with new data at the maximum daily speed available.

In part because of such long retention times, as well as growing Internet upload speeds, Usenet is also used by individual users to store backup data.[29] While commercial providers offer easier to use online backup services, storing data on Usenet is free of charge (although access to Usenet itself may not be). The method requires the uploader to cede control over the distribution of the data; the files are automatically disseminated to all Usenet providers exchanging data for the news group it is posted to. In general the user must manually select, prepare and upload the data. The data is typically encrypted because it is available to anyone to download the backup files. After the files are uploaded, having multiple copies spread to different geographical regions around the world on different news servers decreases the chances of data loss.

Major Usenet service providers have a retention time of more than 12 years.[30] This results in more than 60 petabytes (60000 terabytes) of storage (see image). When using Usenet for data storage, providers that offer longer retention time are preferred to ensure the data will survive for longer periods of time compared to services with lower retention time.

Legal issues

While binary newsgroups can be used to distribute completely legal user-created works, Free software, and public domain material, some binary groups are used to illegally distribute Proprietary software, copyrighted media, and pornographic material.

ISP-operated Usenet servers frequently block access to all alt.binaries.* groups to both reduce network traffic and to avoid related legal issues. Commercial Usenet service providers claim to operate as a telecommunications service, and assert that they are not responsible for the user-posted binary content transferred via their equipment. In the United States, Usenet providers can qualify for protection under the DMCA Safe Harbor regulations, provided that they establish a mechanism to comply with and respond to takedown notices from copyright holders.[31]

Removal of copyrighted content from the entire Usenet network is a nearly impossible task, due to the rapid propagation between servers and the retention done by each server. Petitioning a Usenet provider for removal only removes it from that one server's retention cache, but not any others. It is possible for a special post cancellation message to be distributed to remove it from all servers, but many providers ignore cancel messages by standard policy, because they can be easily falsified and submitted by anyone.[32][33] For a takedown petition to be most effective across the whole network, it would have to be issued to the origin server to which the content has been posted, before it has been propagated to other servers. Removal of the content at this early stage would prevent further propagation, but with modern high speed links, content can be propagated as fast as it arrives, allowing no time for content review and takedown issuance by copyright holders.[34]

Establishing the identity of the person posting illegal content is equally difficult due to the trust-based design of the network. Like SMTP email, servers generally assume the header and origin information in a post is true and accurate. However, as in SMTP email, Usenet post headers are easily falsified so as to obscure the true identity and location of the message source.[35] In this manner, Usenet is significantly different from modern P2P services; most P2P users distributing content are typically immediately identifiable to all other users by their network address, but the origin information for a Usenet posting can be completely obscured and unobtainable once it has propagated past the original server.[36]

Also unlike modern P2P services, the identity of the downloaders is hidden from view. On P2P services a downloader is identifiable to all others by their network address. On Usenet, the downloader connects directly to a server, and only the server knows the address of who is connecting to it. Some Usenet providers do keep usage logs, but not all make this logged information casually available to outside parties such as the Recording Industry Association of America.[37][38][39] The existence of anonymising gateways to USENET also complicates the tracing of a postings true origin.

History

UUCP/Usenet Logical Map — June 1, 1981 / mods by S. McGeady November 19, 1981 (ucbvax) +=+===================================+==+ | | | | | | wivax | | | | | | | | | microsoft| uiucdcs | | | | genradbo | | | | | | (Tektronix) | | | | | | | purdue | | | decvax+===+=+====+=+=+ | | | | | | | | | | | pur-phy | | tekmdp | | | | | | | | | | | +@@@@@@cca | | | | | | | | | | | | | +=pur-ee=+=+=====+===+ | | | csin | | | | | | | | +==o===+===================+==+========+=======+====teklabs=+ | | | | | | | pdp phs grumpy wolfvax | | | | | | | | | | | cincy unc=+===+======+========+ | | | | bio | | | | | (Misc) | | (Misc) | | | | sii reed | dukgeri duke34 utzoo | | | | | | | | | | | | +====+=+=+==+====++======+==++===duke=+===+=======+==+=========+ | | | | | | | | | | | u1100s | bmd70 ucf-cs ucf | andiron | | | | | | | | | | | | | red | | | | | pyuxh | | | | zeppo | | | | | psupdp---psuvax | | | | | | | | | | | alice | whuxlb | utah-cs | | houxf | allegra | | | | | | | | | | | | | | | | | | | +--chico---+ | +===+=mhtsa====research | /=+=======harpo=+==+ | | | | | | | | / | | | | hocsr | | +=+=============+=/ cbosg---+ | | | ucbopt | | | | | esquire | |  : | | | cbosgd | | |  : | | | | | | ucbcory | | eagle==+=====+=====+=====+=====+ | | |  : | | | | | | | | | +-uwvax--+ |  : | | | mhuxa mhuxh mhuxj mhuxm mhuxv | | |  : | | | | | |  : | | | +----------------------------o--+ |  : | | | | | | ucbcad | | | ihpss mh135a | |  : | | | | | | |  : \--o--o------ihnss----vax135----cornell | |  : | | | | | +=+==ucbvax==========+===+==+=+======+=======+=+========+=========+ (UCB) : | | | | (Silicon Valley) ucbarpa cmevax | | menlo70--hao  : | | | | ucbonyx | | | sri-unix | ucsfcgl | | | | Legend: | | sytek====+========+ ------- | | | | - | / \ + = Uucp sdcsvax=+=======+=+======+ intelqa zehntel = "Bus" | | | o jumps sdcarl phonlab sdcattb : Berknet @ Arpanet
UUCP/Usenet Logical Map, original by Steven McGeady.
Copyright© 1981, 1996

Bruce Jones, Henry Spencer, David Wiseman. Copied with permission from

The Usenet Oldnews Archive: Compilation.[40]

Newsgroup experiments first occurred in 1979. Tom Truscott and Jim Ellis of Duke University came up with the idea as a replacement for a local announcement program, and established a link with nearby University of North Carolina using Bourne shell scripts written by Steve Bellovin. The public release of news was in the form of conventional compiled software, written by Steve Daniel and Truscott.[7][41] In 1980, Usenet was connected to ARPANET through UC Berkeley, which had connections to both Usenet and ARPANET. Mark Horton, the graduate student who set up the connection, began "feeding mailing lists from the ARPANET into Usenet" with the "fa" ("From ARPANET"[42]) identifier.[43] Usenet gained 50 member sites in its first year, including Reed College, University of Oklahoma, and Bell Labs,[7] and the number of people using the network increased dramatically; however, it was still a while longer before Usenet users could contribute to ARPANET.[44]

Network

UUCP networks spread quickly due to the lower costs involved, and the ability to use existing leased lines, X.25 links or even ARPANET connections. By 1983, thousands of people participated from more than 500 hosts, mostly universities and Bell Labs sites but also a growing number of Unix-related companies; the number of hosts nearly doubled to 940 in 1984. More than 100 newsgroups existed, more than 20 devoted to Unix and other computer-related topics, and at least a third to recreation.[45][7] As the mesh of UUCP hosts rapidly expanded, it became desirable to distinguish the Usenet subset from the overall network. A vote was taken at the 1982 USENIX conference to choose a new name. The name Usenet was retained, but it was established that it only applied to news.[46] The name UUCPNET became the common name for the overall network.

In addition to UUCP, early Usenet traffic was also exchanged with Fidonet and other dial-up BBS networks. By the mid-1990s there were almost 40,000 FidoNet systems in operation, and it was possible to communicate with millions of users around the world, with only local telephone service. Widespread use of Usenet by the BBS community was facilitated by the introduction of UUCP feeds made possible by MS-DOS implementations of UUCP, such as UFGATE (UUCP to FidoNet Gateway), FSUUCP and UUPC. In 1986, RFC 977 provided the Network News Transfer Protocol (NNTP) specification for distribution of Usenet articles over TCP/IP as a more flexible alternative to informal Internet transfers of UUCP traffic. Since the Internet boom of the 1990s, almost all Usenet distribution is over NNTP.[47]

Software

Early versions of Usenet used Duke's A News software, designed for one or two articles a day. Matt Glickman and Horton at Berkeley produced an improved version called B News that could handle the rising traffic (about 50 articles a day as of late 1983).[7] With a message format that offered compatibility with Internet mail and improved performance, it became the dominant server software. C News, developed by Geoff Collyer and Henry Spencer at the University of Toronto, was comparable to B News in features but offered considerably faster processing. In the early 1990s, InterNetNews by Rich Salz was developed to take advantage of the continuous message flow made possible by NNTP versus the batched store-and-forward design of UUCP. Since that time INN development has continued, and other news server software has also been developed.[48]

Public venue

Usenet was the first Internet community and the place for many of the most important public developments in the pre-commercial Internet. It was the place where Tim Berners-Lee announced the launch of the World Wide Web,[49] where Linus Torvalds announced the Linux project,[50] and where Marc Andreessen announced the creation of the Mosaic browser and the introduction of the image tag,[51] which revolutionized the World Wide Web by turning it into a graphical medium. Activist Amy Goodloe used the platform to maintain an email list for LGBT activism.

Internet jargon and history

Many jargon terms now in common use on the Internet originated or were popularized on Usenet.[52] Likewise, many conflicts which later spread to the rest of the Internet, such as the ongoing difficulties over spamming, began on Usenet.[53]

"Usenet is like a herd of performing elephants with diarrhea. Massive, difficult to redirect, awe-inspiring, entertaining, and a source of mind-boggling amounts of excrement when you least expect it."

— Gene Spafford, 1992

Decline

Sascha Segan of PC Magazine said in 2008 that "Usenet has been dying for years".[54] Segan said that some people pointed to the Eternal September in 1993 as the beginning of Usenet's decline, when AOL began offering Usenet access. He argues that when users began putting large (non-text) files on Usenet by the late 1990s, Usenet disk space and traffic increased correspondingly. Internet service providers questioned why they needed to host space for binary articles.

AOL discontinued Usenet access in 2005. In May 2010, Duke University, whose implementation had started Usenet more than 30 years earlier, decommissioned its Usenet server, citing low usage and rising costs.[55][56] On February 4, 2011, the Usenet news service link at the University of North Carolina at Chapel Hill (news.unc.edu) was retired after 32 years.[citation needed]

In response, John Biggs of TechCrunch said "As long as there are folks who think a command line is better than a mouse, the original text-only social network will live on".[57] While there are still some active text newsgroups on Usenet, the system is now primarily used to share large files between users, and the underlying technology of Usenet remains unchanged.[58]

Usenet traffic changes

Over time, the amount of Usenet traffic has steadily increased. As of 2010 the number of all text posts made in all Big-8 newsgroups averaged 1,800 new messages every hour, with an average of 25,000 messages per day.[59] However, these averages are minuscule in comparison to the traffic in the binary groups.[60] Much of this traffic increase reflects not an increase in discrete users or newsgroup discussions, but instead the combination of massive automated spamming and an increase in the use of .binaries newsgroups[59] in which large files are often posted publicly. A small sampling of the change (measured in feed size per day) follows:

 
Source: altopia.com[citation needed]
Daily Volume Daily Posts Date
4.5 GiB 1996 Dec
9 GiB 1997 Jul
12 GiB 554 k 1998 Jan
26 GiB 609 k 1999 Jan
82 GiB 858 k 2000 Jan
181 GiB 1.24 M 2001 Jan
257 GiB 1.48 M 2002 Jan
492 GiB 2.09 M 2003 Jan
969 GiB 3.30 M 2004 Jan
1.52 TiB 5.09 M 2005 Jan
2.27 TiB 7.54 M 2006 Jan
2.95 TiB 9.84 M 2007 Jan
3.07 TiB 10.13 M 2008 Jan
4.65 TiB 14.64 M 2009 Jan
5.42 TiB 15.66 M 2010 Jan
7.52 TiB 20.12 M 2011 Jan
9.29 TiB 23.91 M 2012 Jan
11.49 TiB 28.14 M 2013 Jan
14.61 TiB 37.56 M 2014 Jan
17.87 TiB 44.19 M 2015 Jan
23.87 TiB 55.59 M 2016 Jan
27.80 TiB 64.55 M 2017 Jan
37.35 TiB 73.95 M 2018 Jan
60.38 TiB 104.04 M 2019 Jan
62.40 TiB 107.49 M 2020 Jan
100.71 TiB 171.86 M 2021 Jan

In 2008, Verizon Communications, Time Warner Cable and Sprint Nextel signed an agreement with Attorney General of New York Andrew Cuomo to shut down access to sources of child pornography.[61] Time Warner Cable stopped offering access to Usenet. Verizon reduced its access to the "Big 8" hierarchies. Sprint stopped access to the alt.* hierarchies. AT&T stopped access to the alt.binaries.* hierarchies. Cuomo never specifically named Usenet in his anti-child pornography campaign. David DeJean of PC World said that some worry that the ISPs used Cuomo's campaign as an excuse to end portions of Usenet access, as it is costly for the Internet service providers and not in high demand by customers. In 2008 AOL, which no longer offered Usenet access, and the four providers that responded to the Cuomo campaign were the five largest Internet service providers in the United States; they had more than 50% of the U.S. ISP market share.[62] On June 8, 2009, AT&T announced that it would no longer provide access to the Usenet service as of July 15, 2009.[63]

AOL announced that it would discontinue its integrated Usenet service in early 2005, citing the growing popularity of weblogs, chat forums and on-line conferencing.[64] The AOL community had a tremendous role in popularizing Usenet some 11 years earlier.[65]

In August 2009, Verizon announced that it would discontinue access to Usenet on September 30, 2009.[66][67] JANET announced it would discontinue Usenet service, effective July 31, 2010, citing Google Groups as an alternative.[68]Microsoft announced that it would discontinue support for its public newsgroups (msnews.microsoft.com) from June 1, 2010, offering web forums as an alternative.[69]

Primary reasons cited for the discontinuance of Usenet service by general ISPs include the decline in volume of actual readers due to competition from blogs, along with cost and liability concerns of increasing proportion of traffic devoted to file-sharing and spam on unused or discontinued groups.[70][71]

Some ISPs did not include pressure from Cuomo's campaign against child pornography as one of their reasons for dropping Usenet feeds as part of their services.[72] ISPs Cox and Atlantic Communications resisted the 2008 trend but both did eventually drop their respective Usenet feeds in 2010.[73][74][75]

Archives

Public archives of Usenet articles have existed since the early days of Usenet, such as the system created by Kenneth Almquist in late 1982.[76][77] Distributed archiving of Usenet posts was suggested in November 1982 by Scott Orshan, who proposed that "Every site should keep all the articles it posted, forever."[78] Also in November of that year, Rick Adams responded to a post asking "Has anyone archived netnews, or does anyone plan to?"[79] by stating that he was, "afraid to admit it, but I started archiving most 'useful' newsgroups as of September 18."[80] In June 1982, Gregory G. Woodbury proposed an "automatic access to archives" system that consisted of "automatic answering of fixed-format messages to a special mail recipient on specified machines."[81]

In 1985, two news archiving systems and one RFC were posted to the Internet. The first system, called keepnews, by Mark M. Swenson of the University of Arizona, was described as "a program that attempts to provide a sane way of extracting and keeping information that comes over Usenet." The main advantage of this system was to allow users to mark articles as worthwhile to retain.[82] The second system, YA News Archiver by Chuq Von Rospach, was similar to keepnews, but was "designed to work with much larger archives where the wonderful quadratic search time feature of the Unix ... becomes a real problem."[83] Von Rospach in early 1985 posted a detailed RFC for "archiving and accessing usenet articles with keyword lookup." This RFC described a program that could "generate and maintain an archive of Usenet articles and allow looking up articles based on the article-id, subject lines, or keywords pulled out of the article itself." Also included was C code for the internal data structure of the system.[84]

The desire to have a fulltext search index of archived news articles is not new either, one such request having been made in April 1991 by Alex Martelli who sought to "build some sort of keyword index for [the news archive]."[85] In early May, Mr. Martelli posted a summary of his responses to Usenet, noting that the "most popular suggestion award must definitely go to 'lq-text' package, by Liam Quin, recently posted in alt.sources."[86]

The Alt Sex Stories Text Repository (ASSTR) site archives and indexes erotic and pornographic stories posted to the Usenet group alt.sex.stories.[87]

The archiving of Usenet has led to fears of loss of privacy.[88] An archive simplifies ways to profile people. This has partly been countered with the introduction of the X-No-Archive: Yes header, which is itself controversial.[89]

Archives by Google Groups and Deja News

Web-based archiving of Usenet posts began in 1995 at Deja News with a very large, searchable database. In 2001, this database was acquired by Google.[90]

Google Groups hosts an archive of Usenet posts dating back to May 1981. The earliest posts, which date from May 1981 to June 1991, were donated to Google by the University of Western Ontario with the help of David Wiseman and others,[91] and were originally archived by Henry Spencer at the University of Toronto's Zoology department.[92] The archives for late 1991 through early 1995 were provided by Kent Landfield from the NetNews CD series[93] and Jürgen Christoffel from GMD.[94] The archive of posts from March 1995 onward was started by the company Deja News (later Deja), which was purchased by Google in February 2001. Google began archiving Usenet posts for itself starting in the second week of August 2000.

Google has been criticized by Vice and Wired contributors as well as former employees for its stewardship of the archive and for breaking its search functionality.[95][96][97]

See also

Usenet newsreaders

Usenet/newsgroup service providers

Usenet history

Usenet administrators

Usenet as a whole has no administrators. Each server administrator is free to do what they want, as long as the end users and peer servers accept it. But there are a few famous administrators:

References

  1. ^ a b From Usenet to CoWebs: interacting with social information spaces, Christopher Lueg, Danyel Fisher, Springer (2003), ISBN 1-85233-532-7, ISBN 978-1-85233-532-8
  2. ^ a b The jargon file v4.4.7 January 5, 2016, at the Wayback Machine, Jargon File Archive.
  3. ^ Chapter 3 - The Social Forces Behind The Development of Usenet August 4, 2016, at the Wayback Machine, Netizens Netbook by Ronda Hauben and Michael Hauben.
  4. ^ "USENET Newsgroup Terms – SPAM". Archived from the original on September 15, 2012.
  5. ^ Pre-Internet; Usenet needing "just local telephone service" in most larger towns, depends on the number of local dial-up Fidonet "nodes" operated free of charge by hobbyist "SysOps" (as FidoNet echomail variations or via gateways with the Usenet news hierarchy. This is virtual Usenet or newsgroups access, not true Usenet.) The participating SysOps typically carry 6 - 30 Usenet newsgroups each, and will often add another on request. If a desired newsgroup was not available locally, a user would need to dial to another city to download the desired news and upload one's own posts. In all cases it is desirable to hang up as soon as possible and read/write offline, making "newsreader" software commonly used to automate the process. Fidonet, bbscorner.com February 7, 2022, at the Wayback Machine
    fidonet.org, Randy_Bush.txt
  6. ^ a b Bonnett, Cara (May 17, 2010). "Duke to shut Usenet server, home to the first electronic newsgroups". Duke University.
  7. ^ a b c d e Emerson, Sandra L. (October 1983). "Usenet / A Bulletin Board for Unix Users". BYTE. pp. 219–236. Retrieved January 31, 2015.
  8. ^ "Invitation to a General Access UNIX Network September 24, 2012, at the Wayback Machine", James Ellis and Tom Truscott, in First Official Announcement of USENET, NewsDemon (K&L Technologies, Inc), 1979
  9. ^ Lehnert, Wendy G.; Kopec, Richard (2007). Web 101. Addison Wesley. p. 291. ISBN 9780321424679
  10. ^ "Store And Forward Communication: UUCP and FidoNet". Archived from the original on June 30, 2012.. Carnegie Mellon School of Computer Science.
  11. ^ Kozierok, Charles M. (2005). The TCP/IP guide: a comprehensive, illustrated Internet protocols reference. No Starch Press. p. 1401. ISBN 978-159327-047-6
  12. ^ One way to virtually read and participate in Usenet newsgroups using an ordinary Internet browser is to do an internet search on a known newsgroup, such as the high volume forum: "sci.physics". Retrieved April 28, 2019
  13. ^ "Best Usenet clients". UsenetReviewz. Retrieved August 13, 2020.
  14. ^ "Open Directory Usenet Clients". Dmoz.org. October 9, 2008. Archived from the original on July 30, 2012. Retrieved December 14, 2010.
  15. ^ Jain, Dominik (July 30, 2006). "OE-QuoteFix Description". Archived from the original on September 21, 2012. Retrieved June 4, 2007.
  16. ^ "Improve-Usenet". October 13, 2008. Archived from the original on July 13, 2012.
  17. ^ . October 13, 2008. Archived from the original on April 26, 2008. Retrieved June 29, 2009.
  18. ^ "Google Groups". Archived from the original on May 25, 2012. Retrieved December 14, 2010.
  19. ^ "News: links to Google Groups". Archived from the original on July 12, 2012.
  20. ^ "Who can force the moderators to obey the group charter?". Big-8.org. Archived from the original on August 4, 2012. Retrieved December 14, 2010.
  21. ^ "How does a group change moderators?". Big-8.org. Archived from the original on July 19, 2012. Retrieved December 14, 2010.
  22. ^ "Early Usenet Newsgroup Hierarchies". Livinginternet.com. October 25, 1990. Archived from the original on September 21, 2012. Retrieved December 14, 2010.
  23. ^ "How to Create a New Big-8 Newsgroup". Big-8.org. July 7, 2010. Archived from the original on July 22, 2012. Retrieved December 14, 2010.
  24. ^ Donath, Judith (May 23, 2014). The Social Machine: Designs for Living Online. ISBN 9780262027014. Today, Usenet still exists, but it is an unsociable morass of spam, porn, and pirated software
  25. ^ "Unraveling the Internet's oldest and weirdest mystery". March 22, 2015. from the original on May 18, 2015. Retrieved May 7, 2015. Groups filled with spam, massive fights took place against spammers and over what to do about the spam. People stopped using their email addresses in messages to avoid harvesting. People left the net.
  26. ^ "The American Way of Spam". from the original on May 18, 2015. Retrieved May 7, 2015. ...many of the newsgroups have since been overrun with junk messages.
  27. ^ Microsoft Responds to the Evolution of Communities September 18, 2012, at the Wayback Machine, Announcement, undated. "Microsoft hitting 'unsubscribe' on newsgroups". Archived from the original on July 12, 2012., CNET, May 4, 2010.
  28. ^ "Usenet storage is more than 60 petabytes (60000 terabytes)". binsearch.info. Archived from the original on May 21, 2020. Retrieved October 20, 2020.
  29. ^ "usenet backup (uBackup)". Wikihow.com. from the original on February 25, 2020. Retrieved October 20, 2020.
  30. ^ "Eweka 4446 Days Retention". Eweka.nl. Archived from the original on October 20, 2020. Retrieved October 20, 2020.
  31. ^ "Digital Millenium Copyright Act". Archived from the original on September 10, 2012.
  32. ^ . Archived from the original on February 15, 2008. Retrieved June 29, 2009. ...Until authenticated cancels catch on, there are no options to avoid forged cancels and allow unforged ones...
  33. ^ Microsoft knowledgebase article stating that many servers ignore cancel messages "Support.microsoft.com". Archived from the original on July 19, 2012.
  34. ^ "Microsoft Word - Surmacz.doc" (PDF). (PDF) from the original on May 21, 2013. Retrieved December 14, 2010.
  35. ^ ...every part of a Usenet post may be forged apart from the left most portion of the "Path:" header... "By-users.co.uk". Archived from the original on July 23, 2012.
  36. ^ "Better living through forgery". Newsgroup: news.admin.misc. June 10, 1995. Usenet: StUPidfuk01@uunet.uu.net. Archived from the original on July 24, 2012. Retrieved December 5, 2014.
  37. ^ "Giganews Privacy Policy". Giganews.com. Archived from the original on July 31, 2012. Retrieved December 14, 2010.
  38. ^ "Privacy Policy UsenetServer". Usenetserver.com. from the original on June 4, 2020. Retrieved July 8, 2020.
  39. ^ "Logging Policy". Aioe.org. June 9, 2005. Archived from the original on July 8, 2012. Retrieved December 14, 2010.
  40. ^ "Quux.org". Archived from the original on July 14, 2012. Retrieved December 14, 2010.
  41. ^ LaQuey, Tracy (1990). The User's directory of computer networks. Digital Press. p. 386. ISBN 978-1555580476
  42. ^ "And So It Begins". from the original on July 15, 2010. Retrieved September 15, 2014.
  43. ^ "History of the Internet, Chapter Three: History of Electronic Mail". from the original on August 12, 2014. Retrieved September 15, 2014.
  44. ^ Hauben, Michael and Hauben, Ronda. "Netizens: On the History and Impact of Usenet and the Internet, On the Early Days of Usenet: The Roots of the Cooperative Online Culture June 10, 2015, at the Wayback Machine". First Monday vol. 3 num.August 8, 3 1998
  45. ^ Haddadi, H. (2006). "Network Traffic Inference Using Sampled Statistics November 17, 2015, at the Wayback Machine". University College London.
  46. ^ Horton, Mark (December 11, 1990). "Arachnet". Archived from the original on September 21, 2012. Retrieved June 4, 2007.
  47. ^ Huston, Geoff (1999). ISP survival guide: strategies for running a competitive ISP. Wiley. p. 439.
  48. ^ "Unix/Linux news servers". Newsreaders.com. Archived from the original on September 5, 2012. Retrieved December 14, 2010.
  49. ^ Tim Berners-Lee (August 6, 1991). "WorldWideWeb: Summary". Newsgroup: alt.hypertext. Usenet: 6487@cernvax.cern.ch. Retrieved June 4, 2007.
  50. ^ Torvalds, Linus. "What would you like to see most in minix?". Newsgroup: comp.os.minix. Usenet: 1991Aug25.205708.9541@klaava.Helsinki.FI. Retrieved September 9, 2006.
  51. ^ Marc Andreessen (March 15, 1993). "NCSA Mosaic for X 0.10 available". Newsgroup: comp.windows.x. Usenet: MARCA.93Mar14225600@wintermute.ncsa.uiuc.edu. from the original on June 16, 2006. Retrieved June 4, 2007.
  52. ^ Kaltenbach, Susan (December 2000). "The Evolution of the Online Discourse Community" (PDF). (PDF) from the original on July 14, 2011. Retrieved May 26, 2010. Verb Doubling: Doubling a verb may change its semantics, Soundalike Slang: Punning jargon, The -P convention: A LISPy way to form questions, Overgeneralization: Standard abuses of grammar, Spoken Inarticulations: Sighing and <*sigh*>ing, Anthropomorphization: online components were named "Homunculi," daemons," etc., and there were also "confused" programs. Comparatives: Standard comparatives for design quality
  53. ^ Campbell, K. K. (October 1, 1994). . Electronic Frontier Foundation. Archived from the original on November 25, 2007. Retrieved September 24, 2010.
  54. ^ Segan, Sascha (July 31, 2008). "R.I.P Usenet: 1980-2008". PC Magazine. Archived from the original on September 9, 2012. Retrieved November 30, 2022.
  55. ^ Cara Bonnett (May 17, 2010). "A Piece of Internet History". Duke Today. Archived from the original on July 11, 2012. Retrieved May 24, 2010.
  56. ^ Andrew Orlowski (May 20, 2010). "Usenet's home shuts down today". The Register. Archived from the original on September 21, 2012. Retrieved May 24, 2010.
  57. ^ ""Reports of Usenet's Death Are Greatly Exaggerated". Archived from the original on July 16, 2012.." TechCrunch. August 1, 2008. Retrieved on May 8, 2011.
  58. ^ "What Is Usenet". Top 10 Usenet. Retrieved February 8, 2021.
  59. ^ a b . NewsAdmin. Archived from the original on October 16, 2006. Retrieved December 14, 2010.
  60. ^ . NewsAdmin. Archived from the original on October 16, 2006. Retrieved December 14, 2010.
  61. ^ Rosencrance, Lisa. "3 top ISPs to block access to sources of child porn". Archived from the original on July 22, 2012.. Computer World. June 8, 2008. Retrieved on April 30, 2009.
  62. ^ DeJean, David. "Usenet: Not Dead Yet." PC World. Tuesday October 7, 2008. "2". October 7, 2008. Archived from the original on September 21, 2012. Retrieved September 17, 2017.. Retrieved on April 30, 2009.
  63. ^ "ATT Announces Discontinuation of USENET Newsgroup Services". NewsDemon. June 9, 2009. Archived from the original on September 21, 2012. Retrieved June 18, 2009.
  64. ^ Hu, Jim. ""AOL shutting down newsgroups". Archived from the original on July 23, 2012.." CNet. January 25, 2005. Retrieved on May 1, 2009.
  65. ^ "AOL Pulls Plug on Newsgroup Service". Betanews.com. January 25, 2005. Archived from the original on July 22, 2012. Retrieved December 14, 2010.
  66. ^ Bode, Karl. "Verizon To Discontinue Newsgroups September 30". Archived from the original on July 31, 2012.. DSLReports. August 31, 2009. Retrieved on October 24, 2009.
  67. ^ ""Verizon Newsgroup Service Has Been Discontinued". Archived from the original on September 21, 2012." Verizon Central Support. Retrieved on October 24, 2009.
  68. ^ Ukerna.ac.uk[]
  69. ^ "Microsoft Responds to the Evolution of Communities". microsoft.com. from the original on June 22, 2003. Retrieved September 1, 2011.
  70. ^ "AOL shutting down newsgroups". cnet.com/. January 25, 2005. from the original on August 29, 2008. Retrieved September 1, 2011.
  71. ^ "Verizon To Discontinue Newsgroups". dslreports.com. August 31, 2009. from the original on March 6, 2012. Retrieved September 1, 2011.
  72. ^ "The Comcast Newsgroups Service Discontinued". dslreports.com. September 16, 2008. from the original on December 6, 2014. Retrieved December 5, 2014.
  73. ^ "Cox to Drop Free Usenet Service June 30th". Zeropaid.com. April 22, 2010. Archived from the original on September 21, 2012. Retrieved September 3, 2011.
  74. ^ "Cox Discontinues Usenet, Starting In June". Geeknet, Inc. April 21, 2010. Archived from the original on September 21, 2012. Retrieved September 1, 2011.
  75. ^ "Cox Communications and Atlantic Broadband Discontinue Usenet Access". thundernews.com. April 27, 2010. Archived from the original on September 12, 2012. Retrieved September 1, 2011.
  76. ^ "How to obtain back news items". Archived from the original on July 10, 2012. Retrieved December 14, 2010.
  77. ^ "How to obtain back news items (second posting)". Newsgroup: net.general. December 21, 1982. from the original on January 29, 2011. Retrieved December 5, 2014. message-id:bnews.spanky.138
  78. ^ "Distributed archiving of netnews". Archived from the original on July 8, 2012. Retrieved December 14, 2010.
  79. ^ "Archive of netnews". Archived from the original on July 24, 2012. Retrieved December 14, 2010.
  80. ^ "Re: Archive of netnews". Archived from the original on July 15, 2012. Retrieved December 14, 2010.
  81. ^ "Automatic access to archives". Archived from the original on July 12, 2012. Retrieved December 14, 2010.
  82. ^ "keepnews – A Usenet news archival system". Archived from the original on July 17, 2012. Retrieved December 14, 2010.
  83. ^ "YA News Archiver". Archived from the original on July 9, 2012. Retrieved December 14, 2010.
  84. ^ "RFC usenet article archive program with keyword lookup". Archived from the original on July 15, 2012. Retrieved December 14, 2010.
  85. ^ "Looking for fulltext indexing software for archived news". Archived from the original on September 21, 2012. Retrieved December 14, 2010.
  86. ^ "Summary: search for fulltext indexing software for archived news". Archived from the original on July 8, 2012. Retrieved December 14, 2010.
  87. ^ . Archived from the original on August 18, 2014. Retrieved August 13, 2014.
  88. ^ Segan, Sascha (July 31, 2008). "R.I.P Usenet: 1980–2008 – Usenet's Decline – Columns by PC Magazine". Pcmag.com. Archived from the original on September 9, 2012. Retrieved December 14, 2010.
  89. ^ Strawbridge, Matthew (2006). Netiquette: Internet Etiquette in the Age of the Blog. Software Reference. p. 53. ISBN 978-0955461408
  90. ^ Cullen, Drew (February 12, 2001). "Google saves Deja.com Usenet service". The Register. Archived from the original on September 21, 2012.. The Register.
  91. ^ Wiseman, David. "Magi's NetNews Archive Involvement" Archived February 9, 2005, at archive.today, csd.uwo.ca.
  92. ^ Mieszkowski, Katharine. ""The Geeks Who Saved Usenet". Archived from the original on July 10, 2012.", archive.salon.com (January 7, 2002).
  93. ^ Feldman, Ian. "Usenet on a CD-ROM, no longer a fable". February 10, 1992. Archived from the original on July 7, 2012., "TidBITS" (February 10, 1992)
  94. ^ "Google Groups Archive Information". Archived from the original on July 9, 2012. (December 21, 2001)
  95. ^ Poulsen, Kevin (October 7, 2009). "Google's Abandoned Library of 700 Million Titles". Wired. from the original on March 9, 2017. Retrieved March 12, 2017.
  96. ^ Braga, Matthew (February 13, 2015). "Google, a Search Company, Has Made Its Internet Archive Impossible to Search". Motherboard. from the original on September 5, 2015. Retrieved August 30, 2015.
  97. ^ Edwards, Douglas (2011). I'm Feeling Lucky: The Confessions of Google Employee Number 59. Houghton Mifflin Harcourt. pp. 209–213. ISBN 978-0-547-41699-1.

Further reading

  • Bruce Jones (July 1, 1997). "USENET History mailing list archive covering 1990-1997". from the original on May 7, 2019.
  • Michael Hauben, Ronda Hauben, and Thomas Truscott (April 27, 1997). Netizens: On the History and Impact of Usenet and the Internet (Perspectives). Wiley-IEEE Computer Society P. ISBN 978-0-8186-7706-9.{{cite book}}: CS1 maint: multiple names: authors list (link)
  • Bryan Pfaffenberger (December 31, 1994). The USENET Book: Finding, Using, and Surviving Newsgroups on the Internet. Addison Wesley. ISBN 978-0-201-40978-9.
  • Kate Gregory; Jim Mann; Tim Parker & Noel Estabrook (June 1995). Using Usenet Newsgroups. Que. ISBN 978-0-7897-0134-3.
  • Mark Harrison (July 1995). The USENET Handbook (Nutshell Handbook). O'Reilly. ISBN 978-1-56592-101-6.
  • Henry Spencer; David Lawrence (January 1998). Managing Usenet. O'Reilly. ISBN 978-1-56592-198-6.
  • Don Rittner (June 1997). Rittner's Field Guide to Usenet. MNS Publishing. ISBN 978-0-937666-50-0.
  • Konstan, J., Miller, B., Maltz, D., Herlocker, J., Gordon, L., and Riedl, J. (March 1997). "GroupLens: applying collaborative filtering to Usenet news". Communications of the ACM. 40 (3): 77–87. CiteSeerX 10.1.1.377.1605. doi:10.1145/245108.245126. S2CID 15008577.{{cite journal}}: CS1 maint: multiple names: authors list (link)
  • Miller, B.; Riedl, J.; Konstan, J. (January 1997). Proceedings of the 1997 Usenix Winter Technical Conference. Experiences with GroupLens: Making Usenet useful again (PDF).
  • . Archived from the original on January 5, 2007. Retrieved June 27, 2006.
  • . Linux Magazine. Archived from the original on February 16, 2007. Retrieved February 13, 2007.{{cite web}}: CS1 maint: unfit URL (link)
  • Schwartz, Randal (June 15, 2006). . Archived from the original on February 16, 2007. Retrieved June 4, 2007.{{cite web}}: CS1 maint: unfit URL (link)
  • Kleiner, Dmytri; Wyrick, Brian (January 29, 2007). . Archived from the original on October 25, 2011. Retrieved June 4, 2007.

External links

  • Usenet information, software, and service providers at Curlie
  • IETF working group USEFOR (USEnet article FORmat), tools.ietf.org
  • A-News Archive: Early Usenet news articles: 1981 to 1982., quux.org
  • UTZoo Archive: 2,000,000 articles from early 1980s to July 1991
  • . Archived from the original on June 21, 2007. Social Accounting Reporting Tool
  • Living Internet A comprehensive history of the Internet, including Usenet. livinginternet.com
  • Usenet Glossary A comprehensive list of Usenet terminology

usenet, worldwide, distributed, discussion, system, available, computers, developed, from, general, purpose, unix, unix, copy, uucp, dial, network, architecture, truscott, ellis, conceived, idea, 1979, established, 1980, users, read, post, messages, called, ar. Usenet ˈ j uː z n ɛ t is a worldwide distributed discussion system available on computers It was developed from the general purpose Unix to Unix Copy UUCP dial up network architecture Tom Truscott and Jim Ellis conceived the idea in 1979 and it was established in 1980 1 Users read and post messages called articles or posts and collectively termed news to one or more topic categories known as newsgroups Usenet resembles a bulletin board system BBS in many respects and is the precursor to the Internet forums that have become widely used Discussions are threaded as with web forums and BBSs though posts are stored on the server sequentially 2 3 A diagram of Usenet servers and clients The coloured dots on the servers represent the newsgroups they carry Coloured arrows between servers indicate newsgroup content exchanges news feeds Arrows between clients and servers indicate that a user is subscribed to a certain newsgroup and reads or submits articles there Notably clients never connect with each other but still have access to each other s posts even when they also never connect to the same server A major difference between a BBS or web message board and Usenet is the absence of a central server and dedicated administrator or hosting provider Usenet is distributed among a large constantly changing set of news servers that store and forward messages to one another via news feeds Individual users may read messages from and post to a local or simply preferred news server which can be operated by anyone and those posts will automatically be forwarded to any other news servers peered with the local one while the local server will receive any news its peers have that it currently lacks This results in the automatic proliferation of content posted by any user on any server to any other user subscribed to the same newsgroups on other servers As with BBSs and message boards individual news servers or service providers are under no obligation to carry any specific content and may refuse to do so for many reasons a news server might attempt to control the spread of spam by refusing to accept or forward any posts that trigger spam filters or a server without high capacity data storage may refuse to carry any newsgroups used primarily for file sharing limiting itself to discussion oriented groups However unlike BBSs and web forums the dispersed nature of Usenet usually permits users who are interested in receiving some content to access it simply by choosing to connect to news servers that carry the feeds they want Usenet is culturally and historically significant in the networked world having given rise to or popularized many widely recognized concepts and terms such as FAQ flame sockpuppet and spam 4 In the early 1990s shortly before access to the Internet became commonly affordable Usenet connections via Fidonet s dial up BBS networks made long distance or worldwide discussions and other communication widespread not needing a server just local telephone service 5 The name Usenet comes from the term users network 2 The first Usenet group was NET general which quickly became net general 6 The first commercial spam on Usenet was from immigration attorneys Canter and Siegel advertising green card services 6 On the Internet Usenet is transported via the Network News Transfer Protocol NNTP on TCP Port 119 for standard unprotected connections and on TCP port 563 for SSL encrypted connections Contents 1 Introduction 2 ISPs news servers and newsfeeds 2 1 Newsreaders 2 2 Moderated and unmoderated newsgroups 2 3 Technical details 2 4 Organization 2 5 Binary content 2 5 1 Binary retention time 2 5 2 Legal issues 3 History 3 1 Network 3 2 Software 3 3 Public venue 3 4 Internet jargon and history 3 5 Decline 4 Usenet traffic changes 5 Archives 5 1 Archives by Google Groups and Deja News 6 See also 6 1 Usenet newsreaders 6 2 Usenet newsgroup service providers 6 3 Usenet history 6 4 Usenet administrators 7 References 8 Further reading 9 External linksIntroduction EditUsenet was conceived in 1979 and publicly established in 1980 at the University of North Carolina at Chapel Hill and Duke University 7 1 over a decade before the World Wide Web went online and thus before the general public received access to the Internet making it one of the oldest computer network communications systems still in widespread use It was originally built on the poor man s ARPANET employing UUCP as its transport protocol to offer mail and file transfers as well as announcements through the newly developed news software such as A News The name Usenet emphasizes its creators hope that the USENIX organization would take an active role in its operation 8 The articles that users post to Usenet are organized into topical categories known as newsgroups which are themselves logically organized into hierarchies of subjects For instance sci math and sci physics are within the sci hierarchy Or talk origins and talk atheism are in the talk hierarchy When a user subscribes to a newsgroup the news client software keeps track of which articles that user has read 9 In most newsgroups the majority of the articles are responses to some other article The set of articles that can be traced to one single non reply article is called a thread Most modern newsreaders display the articles arranged into threads and subthreads For example in the wine making newsgroup rec crafts winemaking someone might start a thread called What s the best yeast and that thread or conversation might grow into dozens of replies long by perhaps six or eight different authors Over several days that conversation about different wine yeasts might branch into several sub threads in a tree like form When a user posts an article it is initially only available on that user s news server Each news server talks to one or more other servers its newsfeeds and exchanges articles with them In this fashion the article is copied from server to server and should eventually reach every server in the network The later peer to peer networks operate on a similar principle but for Usenet it is normally the sender rather than the receiver who initiates transfers Usenet was designed under conditions when networks were much slower and not always available Many sites on the original Usenet network would connect only once or twice a day to batch transfer messages in and out 10 This is largely because the POTS network was typically used for transfers and phone charges were lower at night The format and transmission of Usenet articles is similar to that of Internet e mail messages The difference between the two is that Usenet articles can be read by any user whose news server carries the group to which the message was posted as opposed to email messages which have one or more specific recipients 11 Today Usenet has diminished in importance with respect to Internet forums blogs mailing lists and social media Usenet differs from such media in several ways Usenet requires no personal registration with the group concerned information need not be stored on a remote server archives are always available and reading the messages does not require a mail or web client but a news client However it is now possible to read and participate in Usenet newsgroups to a large degree using ordinary web browsers since most newsgroups are now copied to several web sites 12 The groups in alt binaries are still widely used for data transfer ISPs news servers and newsfeeds Edit Usenet Provider Map Many Internet service providers and many other Internet sites operate news servers for their users to access ISPs that do not operate their own servers directly will often offer their users an account from another provider that specifically operates newsfeeds In early news implementations the server and newsreader were a single program suite running on the same system Today one uses separate newsreader client software a program that resembles an email client but accesses Usenet servers instead 13 Not all ISPs run news servers A news server is one of the most difficult Internet services to administer because of the large amount of data involved small customer base compared to mainstream Internet service and a disproportionately high volume of customer support incidents frequently complaining of missing news articles Some ISPs outsource news operations to specialist sites which will usually appear to a user as though the ISP itself runs the server Many of these sites carry a restricted newsfeed with a limited number of newsgroups Commonly omitted from such a newsfeed are foreign language newsgroups and the alt binaries hierarchy which largely carries software music videos and images and accounts for over 99 percent of article data There are also Usenet providers that offer a full unrestricted service to users whose ISPs do not carry news or that carry a restricted feed Newsreaders Edit Newsgroups are typically accessed with newsreaders applications that allow users to read and reply to postings in newsgroups These applications act as clients to one or more news servers Historically Usenet was associated with the Unix operating system developed at AT amp T but newsreaders were soon available for all major operating systems 14 Email client programs and Internet suites of the late 1990s and 2000s often included an integrated newsreader Newsgroup enthusiasts often criticized these as inferior to standalone newsreaders that made correct use of Usenet protocols standards and conventions 15 With the rise of the World Wide Web WWW web front ends web2news have become more common Web front ends have lowered the technical entry barrier requirements to that of one application and no Usenet NNTP server account There are numerous websites now offering web based gateways to Usenet groups although some people have begun filtering messages made by some of the web interfaces for one reason or another 16 17 Google Groups 18 is one such web based front end and some web browsers can access Google Groups via news protocol links directly 19 Moderated and unmoderated newsgroups Edit A minority of newsgroups are moderated meaning that messages submitted by readers are not distributed directly to Usenet but instead are emailed to the moderators of the newsgroup for approval The moderator is to receive submitted articles review them and inject approved articles so that they can be properly propagated worldwide Articles approved by a moderator must bear the Approved header line Moderators ensure that the messages that readers see in the newsgroup conform to the charter of the newsgroup though they are not required to follow any such rules or guidelines 20 Typically moderators are appointed in the proposal for the newsgroup and changes of moderators follow a succession plan 21 Historically a mod hierarchy existed before Usenet reorganization 22 Now moderated newsgroups may appear in any hierarchy typically with moderated added to the group name Usenet newsgroups in the Big 8 hierarchy are created by proposals called a Request for Discussion or RFD The RFD is required to have the following information newsgroup name checkgroups file entry and moderated or unmoderated status If the group is to be moderated then at least one moderator with a valid email address must be provided Other information which is beneficial but not required includes a charter a rationale and a moderation policy if the group is to be moderated 23 Discussion of the new newsgroup proposal follows and is finished with the members of the Big 8 Management Board making the decision by vote to either approve or disapprove the new newsgroup Unmoderated newsgroups form the majority of Usenet newsgroups and messages submitted by readers for unmoderated newsgroups are immediately propagated for everyone to see Minimal editorial content filtering vs propagation speed form one crux of the Usenet community One little cited defense of propagation is canceling a propagated message but few Usenet users use this command and some news readers do not offer cancellation commands in part because article storage expires in relatively short order anyway Almost all unmoderated Usenet groups tend to receive large amounts of spam 24 25 26 Technical details Edit Usenet is a set of protocols for generating storing and retrieving news articles which resemble Internet mail messages and for exchanging them among a readership which is potentially widely distributed These protocols most commonly use a flooding algorithm which propagates copies throughout a network of participating servers Whenever a message reaches a server that server forwards the message to all its network neighbors that haven t yet seen the article Only one copy of a message is stored per server and each server makes it available on demand to the typically local readers able to access that server The collection of Usenet servers has thus a certain peer to peer character in that they share resources by exchanging them the granularity of exchange however is on a different scale than a modern peer to peer system and this characteristic excludes the actual users of the system who connect to the news servers with a typical client server application much like an email reader RFC 850 was the first formal specification of the messages exchanged by Usenet servers It was superseded by RFC 1036 and subsequently by RFC 5536 and RFC 5537 In cases where unsuitable content has been posted Usenet has support for automated removal of a posting from the whole network by creating a cancel message although due to a lack of authentication and resultant abuse this capability is frequently disabled Copyright holders may still request the manual deletion of infringing material using the provisions of World Intellectual Property Organization treaty implementations such as the United States Online Copyright Infringement Liability Limitation Act but this would require giving notice to each individual news server administrator On the Internet Usenet is transported via the Network News Transfer Protocol NNTP on TCP Port 119 for standard unprotected connections and on TCP port 563 for SSL encrypted connections Organization Edit The Big Nine hierarchies of Usenet The major set of worldwide newsgroups is contained within nine hierarchies eight of which are operated under consensual guidelines that govern their administration and naming The current Big Eight are comp computer related discussions comp software comp sys amiga humanities fine arts literature and philosophy humanities classics humanities design misc misc miscellaneous topics misc education misc forsale misc kids news discussions and announcements about news meaning Usenet not current events news groups news admin rec recreation and entertainment rec music rec arts movies sci science related discussions sci psychology sci research soc social discussions soc college org soc culture african talk talk about various controversial topics talk religion talk politics talk origins See also the Great Renaming The alt hierarchy is not subject to the procedures controlling groups in the Big Eight and it is as a result less organized Groups in the alt hierarchy tend to be more specialized or specific for example there might be a newsgroup under the Big Eight which contains discussions about children s books but a group in the alt hierarchy may be dedicated to one specific author of children s books Binaries are posted in alt binaries making it the largest of all the hierarchies Many other hierarchies of newsgroups are distributed alongside these Regional and language specific hierarchies such as japan malta and ne serve specific countries and regions such as Japan Malta and New England Companies and projects administer their own hierarchies to discuss their products and offer community technical support such as the historical gnu hierarchy from the Free Software Foundation Microsoft closed its newsserver in June 2010 providing support for its products over forums now 27 Some users prefer to use the term Usenet to refer only to the Big Eight hierarchies others include alt as well The more general term netnews incorporates the entire medium including private organizational news systems Informal sub hierarchy conventions also exist answers are typically moderated cross post groups for FAQs An FAQ would be posted within one group and a cross post to the answers group at the head of the hierarchy seen by some as a refining of information in that news group Some subgroups are recursive to the point of some silliness in alt citation needed Binary content Edit A visual example of the many complex steps required to prepare data to be uploaded to Usenet newsgroups These steps must be done again in reverse to download data from Usenet Usenet was originally created to distribute text content encoded in the 7 bit ASCII character set With the help of programs that encode 8 bit values into ASCII it became practical to distribute binary files as content Binary posts due to their size and often dubious copyright status were in time restricted to specific newsgroups making it easier for administrators to allow or disallow the traffic The oldest widely used encoding method for binary content is uuencode from the Unix UUCP package In the late 1980s Usenet articles were often limited to 60 000 characters and larger hard limits exist today Files are therefore commonly split into sections that require reassembly by the reader With the header extensions and the Base64 and Quoted Printable MIME encodings there was a new generation of binary transport In practice MIME has seen increased adoption in text messages but it is avoided for most binary attachments Some operating systems with metadata attached to files use specialized encoding formats For Mac OS both BinHex and special MIME types are used Other lesser known encoding systems that may have been used at one time were BTOA XX encoding BOO and USR encoding In an attempt to reduce file transfer times an informal file encoding known as yEnc was introduced in 2001 It achieves about a 30 reduction in data transferred by assuming that most 8 bit characters can safely be transferred across the network without first encoding into the 7 bit ASCII space The most common method of uploading large binary posts to Usenet is to convert the files into RAR archives and create Parchive files for them Parity files are used to recreate missing data when not every part of the files reaches a server Binary retention time Edit October 2020 screenshot showing 60 PB of usenet group data 28 Each news server allocates a certain amount of storage space for content in each newsgroup When this storage has been filled each time a new post arrives old posts are deleted to make room for the new content If the network bandwidth available to a server is high but the storage allocation is small it is possible for a huge flood of incoming content to overflow the allocation and push out everything that was in the group before it The average length of time that posts are able to stay on the server before being deleted is commonly called the retention time Binary newsgroups are only able to function reliably if there is sufficient storage allocated to handle the amount of articles being added Without sufficient retention time a reader will be unable to download all parts of the binary before it is flushed out of the group s storage allocation This was at one time how posting undesired content was countered the newsgroup would be flooded with random garbage data posts of sufficient quantity to push out all the content to be suppressed This has been compensated by service providers allocating enough storage to retain everything posted each day including spam floods without deleting anything Modern Usenet news servers have enough capacity to archive years of binary content even when flooded with new data at the maximum daily speed available In part because of such long retention times as well as growing Internet upload speeds Usenet is also used by individual users to store backup data 29 While commercial providers offer easier to use online backup services storing data on Usenet is free of charge although access to Usenet itself may not be The method requires the uploader to cede control over the distribution of the data the files are automatically disseminated to all Usenet providers exchanging data for the news group it is posted to In general the user must manually select prepare and upload the data The data is typically encrypted because it is available to anyone to download the backup files After the files are uploaded having multiple copies spread to different geographical regions around the world on different news servers decreases the chances of data loss Major Usenet service providers have a retention time of more than 12 years 30 This results in more than 60 petabytes 60000 terabytes of storage see image When using Usenet for data storage providers that offer longer retention time are preferred to ensure the data will survive for longer periods of time compared to services with lower retention time Legal issues Edit While binary newsgroups can be used to distribute completely legal user created works Free software and public domain material some binary groups are used to illegally distribute Proprietary software copyrighted media and pornographic material ISP operated Usenet servers frequently block access to all alt binaries groups to both reduce network traffic and to avoid related legal issues Commercial Usenet service providers claim to operate as a telecommunications service and assert that they are not responsible for the user posted binary content transferred via their equipment In the United States Usenet providers can qualify for protection under the DMCA Safe Harbor regulations provided that they establish a mechanism to comply with and respond to takedown notices from copyright holders 31 Removal of copyrighted content from the entire Usenet network is a nearly impossible task due to the rapid propagation between servers and the retention done by each server Petitioning a Usenet provider for removal only removes it from that one server s retention cache but not any others It is possible for a special post cancellation message to be distributed to remove it from all servers but many providers ignore cancel messages by standard policy because they can be easily falsified and submitted by anyone 32 33 For a takedown petition to be most effective across the whole network it would have to be issued to the origin server to which the content has been posted before it has been propagated to other servers Removal of the content at this early stage would prevent further propagation but with modern high speed links content can be propagated as fast as it arrives allowing no time for content review and takedown issuance by copyright holders 34 Establishing the identity of the person posting illegal content is equally difficult due to the trust based design of the network Like SMTP email servers generally assume the header and origin information in a post is true and accurate However as in SMTP email Usenet post headers are easily falsified so as to obscure the true identity and location of the message source 35 In this manner Usenet is significantly different from modern P2P services most P2P users distributing content are typically immediately identifiable to all other users by their network address but the origin information for a Usenet posting can be completely obscured and unobtainable once it has propagated past the original server 36 Also unlike modern P2P services the identity of the downloaders is hidden from view On P2P services a downloader is identifiable to all others by their network address On Usenet the downloader connects directly to a server and only the server knows the address of who is connecting to it Some Usenet providers do keep usage logs but not all make this logged information casually available to outside parties such as the Recording Industry Association of America 37 38 39 The existence of anonymising gateways to USENET also complicates the tracing of a postings true origin History EditUUCP Usenet Logical Map June 1 1981 mods by S McGeady November 19 1981 ucbvax wivax microsoft uiucdcs genradbo Tektronix purdue decvax pur phy tekmdp cca pur ee csin o teklabs pdp phs grumpy wolfvax cincy unc bio Misc Misc sii reed dukgeri duke34 utzoo duke u1100s bmd70 ucf cs ucf andiron red pyuxh zeppo psupdp psuvax alice whuxlb utah cs houxf allegra chico mhtsa research harpo hocsr cbosg ucbopt esquire cbosgd ucbcory eagle uwvax mhuxa mhuxh mhuxj mhuxm mhuxv o ucbcad ihpss mh135a o o ihnss vax135 cornell ucbvax UCB Silicon Valley ucbarpa cmevax menlo70 hao ucbonyx sri unix ucsfcgl Legend sytek Uucp sdcsvax intelqa zehntel Bus o jumps sdcarl phonlab sdcattb Berknet Arpanet UUCP Usenet Logical Map original by Steven McGeady Copyright c 1981 1996Bruce Jones Henry Spencer David Wiseman Copied with permission from The Usenet Oldnews Archive Compilation 40 Newsgroup experiments first occurred in 1979 Tom Truscott and Jim Ellis of Duke University came up with the idea as a replacement for a local announcement program and established a link with nearby University of North Carolina using Bourne shell scripts written by Steve Bellovin The public release of news was in the form of conventional compiled software written by Steve Daniel and Truscott 7 41 In 1980 Usenet was connected to ARPANET through UC Berkeley which had connections to both Usenet and ARPANET Mark Horton the graduate student who set up the connection began feeding mailing lists from the ARPANET into Usenet with the fa From ARPANET 42 identifier 43 Usenet gained 50 member sites in its first year including Reed College University of Oklahoma and Bell Labs 7 and the number of people using the network increased dramatically however it was still a while longer before Usenet users could contribute to ARPANET 44 Network Edit UUCP networks spread quickly due to the lower costs involved and the ability to use existing leased lines X 25 links or even ARPANET connections By 1983 thousands of people participated from more than 500 hosts mostly universities and Bell Labs sites but also a growing number of Unix related companies the number of hosts nearly doubled to 940 in 1984 More than 100 newsgroups existed more than 20 devoted to Unix and other computer related topics and at least a third to recreation 45 7 As the mesh of UUCP hosts rapidly expanded it became desirable to distinguish the Usenet subset from the overall network A vote was taken at the 1982 USENIX conference to choose a new name The name Usenet was retained but it was established that it only applied to news 46 The name UUCPNET became the common name for the overall network In addition to UUCP early Usenet traffic was also exchanged with Fidonet and other dial up BBS networks By the mid 1990s there were almost 40 000 FidoNet systems in operation and it was possible to communicate with millions of users around the world with only local telephone service Widespread use of Usenet by the BBS community was facilitated by the introduction of UUCP feeds made possible by MS DOS implementations of UUCP such as UFGATE UUCP to FidoNet Gateway FSUUCP and UUPC In 1986 RFC 977 provided the Network News Transfer Protocol NNTP specification for distribution of Usenet articles over TCP IP as a more flexible alternative to informal Internet transfers of UUCP traffic Since the Internet boom of the 1990s almost all Usenet distribution is over NNTP 47 Software Edit Early versions of Usenet used Duke s A News software designed for one or two articles a day Matt Glickman and Horton at Berkeley produced an improved version called B News that could handle the rising traffic about 50 articles a day as of late 1983 7 With a message format that offered compatibility with Internet mail and improved performance it became the dominant server software C News developed by Geoff Collyer and Henry Spencer at the University of Toronto was comparable to B News in features but offered considerably faster processing In the early 1990s InterNetNews by Rich Salz was developed to take advantage of the continuous message flow made possible by NNTP versus the batched store and forward design of UUCP Since that time INN development has continued and other news server software has also been developed 48 Public venue Edit Usenet was the first Internet community and the place for many of the most important public developments in the pre commercial Internet It was the place where Tim Berners Lee announced the launch of the World Wide Web 49 where Linus Torvalds announced the Linux project 50 and where Marc Andreessen announced the creation of the Mosaic browser and the introduction of the image tag 51 which revolutionized the World Wide Web by turning it into a graphical medium Activist Amy Goodloe used the platform to maintain an email list for LGBT activism Internet jargon and history EditMany jargon terms now in common use on the Internet originated or were popularized on Usenet 52 Likewise many conflicts which later spread to the rest of the Internet such as the ongoing difficulties over spamming began on Usenet 53 Usenet is like a herd of performing elephants with diarrhea Massive difficult to redirect awe inspiring entertaining and a source of mind boggling amounts of excrement when you least expect it Gene Spafford 1992 Decline Edit Sascha Segan of PC Magazine said in 2008 that Usenet has been dying for years 54 Segan said that some people pointed to the Eternal September in 1993 as the beginning of Usenet s decline when AOL began offering Usenet access He argues that when users began putting large non text files on Usenet by the late 1990s Usenet disk space and traffic increased correspondingly Internet service providers questioned why they needed to host space for binary articles AOL discontinued Usenet access in 2005 In May 2010 Duke University whose implementation had started Usenet more than 30 years earlier decommissioned its Usenet server citing low usage and rising costs 55 56 On February 4 2011 the Usenet news service link at the University of North Carolina at Chapel Hill news unc edu was retired after 32 years citation needed In response John Biggs of TechCrunch said As long as there are folks who think a command line is better than a mouse the original text only social network will live on 57 While there are still some active text newsgroups on Usenet the system is now primarily used to share large files between users and the underlying technology of Usenet remains unchanged 58 Usenet traffic changes EditOver time the amount of Usenet traffic has steadily increased As of 2010 update the number of all text posts made in all Big 8 newsgroups averaged 1 800 new messages every hour with an average of 25 000 messages per day 59 However these averages are minuscule in comparison to the traffic in the binary groups 60 Much of this traffic increase reflects not an increase in discrete users or newsgroup discussions but instead the combination of massive automated spamming and an increase in the use of binaries newsgroups 59 in which large files are often posted publicly A small sampling of the change measured in feed size per day follows Source altopia com citation needed Daily Volume Daily Posts Date4 5 GiB 1996 Dec9 GiB 1997 Jul12 GiB 554 k 1998 Jan26 GiB 609 k 1999 Jan82 GiB 858 k 2000 Jan181 GiB 1 24 M 2001 Jan257 GiB 1 48 M 2002 Jan492 GiB 2 09 M 2003 Jan969 GiB 3 30 M 2004 Jan1 52 TiB 5 09 M 2005 Jan2 27 TiB 7 54 M 2006 Jan2 95 TiB 9 84 M 2007 Jan3 07 TiB 10 13 M 2008 Jan4 65 TiB 14 64 M 2009 Jan5 42 TiB 15 66 M 2010 Jan7 52 TiB 20 12 M 2011 Jan9 29 TiB 23 91 M 2012 Jan11 49 TiB 28 14 M 2013 Jan14 61 TiB 37 56 M 2014 Jan17 87 TiB 44 19 M 2015 Jan23 87 TiB 55 59 M 2016 Jan27 80 TiB 64 55 M 2017 Jan37 35 TiB 73 95 M 2018 Jan60 38 TiB 104 04 M 2019 Jan62 40 TiB 107 49 M 2020 Jan100 71 TiB 171 86 M 2021 JanIn 2008 Verizon Communications Time Warner Cable and Sprint Nextel signed an agreement with Attorney General of New York Andrew Cuomo to shut down access to sources of child pornography 61 Time Warner Cable stopped offering access to Usenet Verizon reduced its access to the Big 8 hierarchies Sprint stopped access to the alt hierarchies AT amp T stopped access to the alt binaries hierarchies Cuomo never specifically named Usenet in his anti child pornography campaign David DeJean of PC World said that some worry that the ISPs used Cuomo s campaign as an excuse to end portions of Usenet access as it is costly for the Internet service providers and not in high demand by customers In 2008 AOL which no longer offered Usenet access and the four providers that responded to the Cuomo campaign were the five largest Internet service providers in the United States they had more than 50 of the U S ISP market share 62 On June 8 2009 AT amp T announced that it would no longer provide access to the Usenet service as of July 15 2009 63 AOL announced that it would discontinue its integrated Usenet service in early 2005 citing the growing popularity of weblogs chat forums and on line conferencing 64 The AOL community had a tremendous role in popularizing Usenet some 11 years earlier 65 In August 2009 Verizon announced that it would discontinue access to Usenet on September 30 2009 66 67 JANET announced it would discontinue Usenet service effective July 31 2010 citing Google Groups as an alternative 68 Microsoft announced that it would discontinue support for its public newsgroups msnews microsoft com from June 1 2010 offering web forums as an alternative 69 Primary reasons cited for the discontinuance of Usenet service by general ISPs include the decline in volume of actual readers due to competition from blogs along with cost and liability concerns of increasing proportion of traffic devoted to file sharing and spam on unused or discontinued groups 70 71 Some ISPs did not include pressure from Cuomo s campaign against child pornography as one of their reasons for dropping Usenet feeds as part of their services 72 ISPs Cox and Atlantic Communications resisted the 2008 trend but both did eventually drop their respective Usenet feeds in 2010 73 74 75 Archives EditPublic archives of Usenet articles have existed since the early days of Usenet such as the system created by Kenneth Almquist in late 1982 76 77 Distributed archiving of Usenet posts was suggested in November 1982 by Scott Orshan who proposed that Every site should keep all the articles it posted forever 78 Also in November of that year Rick Adams responded to a post asking Has anyone archived netnews or does anyone plan to 79 by stating that he was afraid to admit it but I started archiving most useful newsgroups as of September 18 80 In June 1982 Gregory G Woodbury proposed an automatic access to archives system that consisted of automatic answering of fixed format messages to a special mail recipient on specified machines 81 In 1985 two news archiving systems and one RFC were posted to the Internet The first system called keepnews by Mark M Swenson of the University of Arizona was described as a program that attempts to provide a sane way of extracting and keeping information that comes over Usenet The main advantage of this system was to allow users to mark articles as worthwhile to retain 82 The second system YA News Archiver by Chuq Von Rospach was similar to keepnews but was designed to work with much larger archives where the wonderful quadratic search time feature of the Unix becomes a real problem 83 Von Rospach in early 1985 posted a detailed RFC for archiving and accessing usenet articles with keyword lookup This RFC described a program that could generate and maintain an archive of Usenet articles and allow looking up articles based on the article id subject lines or keywords pulled out of the article itself Also included was C code for the internal data structure of the system 84 The desire to have a fulltext search index of archived news articles is not new either one such request having been made in April 1991 by Alex Martelli who sought to build some sort of keyword index for the news archive 85 In early May Mr Martelli posted a summary of his responses to Usenet noting that the most popular suggestion award must definitely go to lq text package by Liam Quin recently posted in alt sources 86 The Alt Sex Stories Text Repository ASSTR site archives and indexes erotic and pornographic stories posted to the Usenet group alt sex stories 87 The archiving of Usenet has led to fears of loss of privacy 88 An archive simplifies ways to profile people This has partly been countered with the introduction of the X No Archive Yes header which is itself controversial 89 Archives by Google Groups and Deja News Edit Main article Google Groups Web based archiving of Usenet posts began in 1995 at Deja News with a very large searchable database In 2001 this database was acquired by Google 90 Google Groups hosts an archive of Usenet posts dating back to May 1981 The earliest posts which date from May 1981 to June 1991 were donated to Google by the University of Western Ontario with the help of David Wiseman and others 91 and were originally archived by Henry Spencer at the University of Toronto s Zoology department 92 The archives for late 1991 through early 1995 were provided by Kent Landfield from the NetNews CD series 93 and Jurgen Christoffel from GMD 94 The archive of posts from March 1995 onward was started by the company Deja News later Deja which was purchased by Google in February 2001 Google began archiving Usenet posts for itself starting in the second week of August 2000 Google has been criticized by Vice and Wired contributors as well as former employees for its stewardship of the archive and for breaking its search functionality 95 96 97 See also Edit Internet portalUsenet II PLATO Notes Usenet Celebrity Usenet newsreaders Edit Newsreader Usenet Comparison of Usenet newsreaders List of Usenet newsreaders Usenet newsgroup service providers Edit Astraweb Easynews Giganews Supernews Usenet history Edit Scientology and the Internet Serdar Argic Usenet administrators Edit Usenet as a whole has no administrators Each server administrator is free to do what they want as long as the end users and peer servers accept it But there are a few famous administrators Chris Lewis Gene Spafford a k a Spaf Henry Spencer Kai Puolamaki Mary Ann HortonReferences Edit a b From Usenet to CoWebs interacting with social information spaces Christopher Lueg Danyel Fisher Springer 2003 ISBN 1 85233 532 7 ISBN 978 1 85233 532 8 a b The jargon file v4 4 7 Archived January 5 2016 at the Wayback Machine Jargon File Archive Chapter 3 The Social Forces Behind The Development of Usenet Archived August 4 2016 at the Wayback Machine Netizens Netbook by Ronda Hauben and Michael Hauben USENET Newsgroup Terms SPAM Archived from the original on September 15 2012 Pre Internet Usenet needing just local telephone service in most larger towns depends on the number of local dial up Fidonet nodes operated free of charge by hobbyist SysOps as FidoNet echomail variations or via gateways with the Usenet news hierarchy This is virtual Usenet or newsgroups access not true Usenet The participating SysOps typically carry 6 30 Usenet newsgroups each and will often add another on request If a desired newsgroup was not available locally a user would need to dial to another city to download the desired news and upload one s own posts In all cases it is desirable to hang up as soon as possible and read write offline making newsreader software commonly used to automate the process Fidonet bbscorner com Archived February 7 2022 at the Wayback Machine fidonet org Randy Bush txt a b Bonnett Cara May 17 2010 Duke to shut Usenet server home to the first electronic newsgroups Duke University a b c d e Emerson Sandra L October 1983 Usenet A Bulletin Board for Unix Users BYTE pp 219 236 Retrieved January 31 2015 Invitation to a General Access UNIX Network Archived September 24 2012 at the Wayback Machine James Ellis and Tom Truscott in First Official Announcement of USENET NewsDemon K amp L Technologies Inc 1979 Lehnert Wendy G Kopec Richard 2007 Web 101 Addison Wesley p 291 ISBN 9780321424679 Store And Forward Communication UUCP and FidoNet Archived from the original on June 30 2012 Carnegie Mellon School of Computer Science Kozierok Charles M 2005 The TCP IP guide a comprehensive illustrated Internet protocols reference No Starch Press p 1401 ISBN 978 159327 047 6 One way to virtually read and participate in Usenet newsgroups using an ordinary Internet browser is to do an internet search on a known newsgroup such as the high volume forum sci physics Retrieved April 28 2019 Best Usenet clients UsenetReviewz Retrieved August 13 2020 Open Directory Usenet Clients Dmoz org October 9 2008 Archived from the original on July 30 2012 Retrieved December 14 2010 Jain Dominik July 30 2006 OE QuoteFix Description Archived from the original on September 21 2012 Retrieved June 4 2007 Improve Usenet October 13 2008 Archived from the original on July 13 2012 Improve Usenet Comments October 13 2008 Archived from the original on April 26 2008 Retrieved June 29 2009 Google Groups Archived from the original on May 25 2012 Retrieved December 14 2010 News links to Google Groups Archived from the original on July 12 2012 Who can force the moderators to obey the group charter Big 8 org Archived from the original on August 4 2012 Retrieved December 14 2010 How does a group change moderators Big 8 org Archived from the original on July 19 2012 Retrieved December 14 2010 Early Usenet Newsgroup Hierarchies Livinginternet com October 25 1990 Archived from the original on September 21 2012 Retrieved December 14 2010 How to Create a New Big 8 Newsgroup Big 8 org July 7 2010 Archived from the original on July 22 2012 Retrieved December 14 2010 Donath Judith May 23 2014 The Social Machine Designs for Living Online ISBN 9780262027014 Today Usenet still exists but it is an unsociable morass of spam porn and pirated software Unraveling the Internet s oldest and weirdest mystery March 22 2015 Archived from the original on May 18 2015 Retrieved May 7 2015 Groups filled with spam massive fights took place against spammers and over what to do about the spam People stopped using their email addresses in messages to avoid harvesting People left the net The American Way of Spam Archived from the original on May 18 2015 Retrieved May 7 2015 many of the newsgroups have since been overrun with junk messages Microsoft Responds to the Evolution of Communities Archived September 18 2012 at the Wayback Machine Announcement undated Microsoft hitting unsubscribe on newsgroups Archived from the original on July 12 2012 CNET May 4 2010 Usenet storage is more than 60 petabytes 60000 terabytes binsearch info Archived from the original on May 21 2020 Retrieved October 20 2020 usenet backup uBackup Wikihow com Archived from the original on February 25 2020 Retrieved October 20 2020 Eweka 4446 Days Retention Eweka nl Archived from the original on October 20 2020 Retrieved October 20 2020 Digital Millenium Copyright Act Archived from the original on September 10 2012 Cancel Messages FAQ Archived from the original on February 15 2008 Retrieved June 29 2009 Until authenticated cancels catch on there are no options to avoid forged cancels and allow unforged ones Microsoft knowledgebase article stating that many servers ignore cancel messages Support microsoft com Archived from the original on July 19 2012 Microsoft Word Surmacz doc PDF Archived PDF from the original on May 21 2013 Retrieved December 14 2010 every part of a Usenet post may be forged apart from the left most portion of the Path header By users co uk Archived from the original on July 23 2012 Better living through forgery Newsgroup news admin misc June 10 1995 Usenet StUPidfuk01 uunet uu net Archived from the original on July 24 2012 Retrieved December 5 2014 Giganews Privacy Policy Giganews com Archived from the original on July 31 2012 Retrieved December 14 2010 Privacy Policy UsenetServer Usenetserver com Archived from the original on June 4 2020 Retrieved July 8 2020 Logging Policy Aioe org June 9 2005 Archived from the original on July 8 2012 Retrieved December 14 2010 Quux org Archived from the original on July 14 2012 Retrieved December 14 2010 LaQuey Tracy 1990 The User s directory of computer networks Digital Press p 386 ISBN 978 1555580476 And So It Begins Archived from the original on July 15 2010 Retrieved September 15 2014 History of the Internet Chapter Three History of Electronic Mail Archived from the original on August 12 2014 Retrieved September 15 2014 Hauben Michael and Hauben Ronda Netizens On the History and Impact of Usenet and the Internet On the Early Days of Usenet The Roots of the Cooperative Online Culture Archived June 10 2015 at the Wayback Machine First Monday vol 3 num August 8 3 1998 Haddadi H 2006 Network Traffic Inference Using Sampled Statistics Archived November 17 2015 at the Wayback Machine University College London Horton Mark December 11 1990 Arachnet Archived from the original on September 21 2012 Retrieved June 4 2007 Huston Geoff 1999 ISP survival guide strategies for running a competitive ISP Wiley p 439 Unix Linux news servers Newsreaders com Archived from the original on September 5 2012 Retrieved December 14 2010 Tim Berners Lee August 6 1991 WorldWideWeb Summary Newsgroup alt hypertext Usenet 6487 cernvax cern ch Retrieved June 4 2007 Torvalds Linus What would you like to see most in minix Newsgroup comp os minix Usenet 1991Aug25 205708 9541 klaava Helsinki FI Retrieved September 9 2006 Marc Andreessen March 15 1993 NCSA Mosaic for X 0 10 available Newsgroup comp windows x Usenet MARCA 93Mar14225600 wintermute ncsa uiuc edu Archived from the original on June 16 2006 Retrieved June 4 2007 Kaltenbach Susan December 2000 The Evolution of the Online Discourse Community PDF Archived PDF from the original on July 14 2011 Retrieved May 26 2010 Verb Doubling Doubling a verb may change its semantics Soundalike Slang Punning jargon The P convention A LISPy way to form questions Overgeneralization Standard abuses of grammar Spoken Inarticulations Sighing and lt sigh gt ing Anthropomorphization online components were named Homunculi daemons etc and there were also confused programs Comparatives Standard comparatives for design quality Campbell K K October 1 1994 Chatting With Martha Siegel of the Internet s Infamous Canter amp Siegel Electronic Frontier Foundation Archived from the original on November 25 2007 Retrieved September 24 2010 Segan Sascha July 31 2008 R I P Usenet 1980 2008 PC Magazine Archived from the original on September 9 2012 Retrieved November 30 2022 Cara Bonnett May 17 2010 A Piece of Internet History Duke Today Archived from the original on July 11 2012 Retrieved May 24 2010 Andrew Orlowski May 20 2010 Usenet s home shuts down today The Register Archived from the original on September 21 2012 Retrieved May 24 2010 Reports of Usenet s Death Are Greatly Exaggerated Archived from the original on July 16 2012 TechCrunch August 1 2008 Retrieved on May 8 2011 What Is Usenet Top 10 Usenet Retrieved February 8 2021 a b Top 100 text newsgroups by postings NewsAdmin Archived from the original on October 16 2006 Retrieved December 14 2010 Top 100 binary newsgroups by postings NewsAdmin Archived from the original on October 16 2006 Retrieved December 14 2010 Rosencrance Lisa 3 top ISPs to block access to sources of child porn Archived from the original on July 22 2012 Computer World June 8 2008 Retrieved on April 30 2009 DeJean David Usenet Not Dead Yet PC World Tuesday October 7 2008 2 October 7 2008 Archived from the original on September 21 2012 Retrieved September 17 2017 Retrieved on April 30 2009 ATT Announces Discontinuation of USENET Newsgroup Services NewsDemon June 9 2009 Archived from the original on September 21 2012 Retrieved June 18 2009 Hu Jim AOL shutting down newsgroups Archived from the original on July 23 2012 CNet January 25 2005 Retrieved on May 1 2009 AOL Pulls Plug on Newsgroup Service Betanews com January 25 2005 Archived from the original on July 22 2012 Retrieved December 14 2010 Bode Karl Verizon To Discontinue Newsgroups September 30 Archived from the original on July 31 2012 DSLReports August 31 2009 Retrieved on October 24 2009 Verizon Newsgroup Service Has Been Discontinued Archived from the original on September 21 2012 Verizon Central Support Retrieved on October 24 2009 Ukerna ac uk dead link Microsoft Responds to the Evolution of Communities microsoft com Archived from the original on June 22 2003 Retrieved September 1 2011 AOL shutting down newsgroups cnet com January 25 2005 Archived from the original on August 29 2008 Retrieved September 1 2011 Verizon To Discontinue Newsgroups dslreports com August 31 2009 Archived from the original on March 6 2012 Retrieved September 1 2011 The Comcast Newsgroups Service Discontinued dslreports com September 16 2008 Archived from the original on December 6 2014 Retrieved December 5 2014 Cox to Drop Free Usenet Service June 30th Zeropaid com April 22 2010 Archived from the original on September 21 2012 Retrieved September 3 2011 Cox Discontinues Usenet Starting In June Geeknet Inc April 21 2010 Archived from the original on September 21 2012 Retrieved September 1 2011 Cox Communications and Atlantic Broadband Discontinue Usenet Access thundernews com April 27 2010 Archived from the original on September 12 2012 Retrieved September 1 2011 How to obtain back news items Archived from the original on July 10 2012 Retrieved December 14 2010 How to obtain back news items second posting Newsgroup net general December 21 1982 Archived from the original on January 29 2011 Retrieved December 5 2014 message id bnews spanky 138 Distributed archiving of netnews Archived from the original on July 8 2012 Retrieved December 14 2010 Archive of netnews Archived from the original on July 24 2012 Retrieved December 14 2010 Re Archive of netnews Archived from the original on July 15 2012 Retrieved December 14 2010 Automatic access to archives Archived from the original on July 12 2012 Retrieved December 14 2010 keepnews A Usenet news archival system Archived from the original on July 17 2012 Retrieved December 14 2010 YA News Archiver Archived from the original on July 9 2012 Retrieved December 14 2010 RFC usenet article archive program with keyword lookup Archived from the original on July 15 2012 Retrieved December 14 2010 Looking for fulltext indexing software for archived news Archived from the original on September 21 2012 Retrieved December 14 2010 Summary search for fulltext indexing software for archived news Archived from the original on July 8 2012 Retrieved December 14 2010 Asstr org Archived from the original on August 18 2014 Retrieved August 13 2014 Segan Sascha July 31 2008 R I P Usenet 1980 2008 Usenet s Decline Columns by PC Magazine Pcmag com Archived from the original on September 9 2012 Retrieved December 14 2010 Strawbridge Matthew 2006 Netiquette Internet Etiquette in the Age of the Blog Software Reference p 53 ISBN 978 0955461408 Cullen Drew February 12 2001 Google saves Deja com Usenet service The Register Archived from the original on September 21 2012 The Register Wiseman David Magi s NetNews Archive Involvement Archived February 9 2005 at archive today csd uwo ca Mieszkowski Katharine The Geeks Who Saved Usenet Archived from the original on July 10 2012 archive salon com January 7 2002 Feldman Ian Usenet on a CD ROM no longer a fable February 10 1992 Archived from the original on July 7 2012 TidBITS February 10 1992 Google Groups Archive Information Archived from the original on July 9 2012 December 21 2001 Poulsen Kevin October 7 2009 Google s Abandoned Library of 700 Million Titles Wired Archived from the original on March 9 2017 Retrieved March 12 2017 Braga Matthew February 13 2015 Google a Search Company Has Made Its Internet Archive Impossible to Search Motherboard Archived from the original on September 5 2015 Retrieved August 30 2015 Edwards Douglas 2011 I m Feeling Lucky The Confessions of Google Employee Number 59 Houghton Mifflin Harcourt pp 209 213 ISBN 978 0 547 41699 1 Further reading EditBruce Jones July 1 1997 USENET History mailing list archive covering 1990 1997 Archived from the original on May 7 2019 Michael Hauben Ronda Hauben and Thomas Truscott April 27 1997 Netizens On the History and Impact of Usenet and the Internet Perspectives Wiley IEEE Computer Society P ISBN 978 0 8186 7706 9 a href Template Cite book html title Template Cite book cite book a CS1 maint multiple names authors list link Bryan Pfaffenberger December 31 1994 The USENET Book Finding Using and Surviving Newsgroups on the Internet Addison Wesley ISBN 978 0 201 40978 9 Kate Gregory Jim Mann Tim Parker amp Noel Estabrook June 1995 Using Usenet Newsgroups Que ISBN 978 0 7897 0134 3 Mark Harrison July 1995 The USENET Handbook Nutshell Handbook O Reilly ISBN 978 1 56592 101 6 Henry Spencer David Lawrence January 1998 Managing Usenet O Reilly ISBN 978 1 56592 198 6 Don Rittner June 1997 Rittner s Field Guide to Usenet MNS Publishing ISBN 978 0 937666 50 0 Konstan J Miller B Maltz D Herlocker J Gordon L and Riedl J March 1997 GroupLens applying collaborative filtering to Usenet news Communications of the ACM 40 3 77 87 CiteSeerX 10 1 1 377 1605 doi 10 1145 245108 245126 S2CID 15008577 a href Template Cite journal html title Template Cite journal cite journal a CS1 maint multiple names authors list link Miller B Riedl J Konstan J January 1997 Proceedings of the 1997 Usenix Winter Technical Conference Experiences with GroupLens Making Usenet useful again PDF 20 Year Usenet Timeline Archived from the original on January 5 2007 Retrieved June 27 2006 Web 2 0 Meet Usenet 1 0 Linux Magazine Archived from the original on February 16 2007 Retrieved February 13 2007 a href Template Cite web html title Template Cite web cite web a CS1 maint unfit URL link Schwartz Randal June 15 2006 Web 2 0 Meet Usenet 1 0 Archived from the original on February 16 2007 Retrieved June 4 2007 a href Template Cite web html title Template Cite web cite web a CS1 maint unfit URL link Kleiner Dmytri Wyrick Brian January 29 2007 InfoEnclosure 2 0 Archived from the original on October 25 2011 Retrieved June 4 2007 External links Edit Wikimedia Commons has media related to Usenet Usenet information software and service providers at Curlie IETF working group USEFOR USEnet article FORmat tools ietf org A News Archive Early Usenet news articles 1981 to 1982 quux org UTZoo Archive 2 000 000 articles from early 1980s to July 1991 Netscan Archived from the original on June 21 2007 Social Accounting Reporting Tool Living Internet A comprehensive history of the Internet including Usenet livinginternet com Usenet Glossary A comprehensive list of Usenet terminology Retrieved from https en wikipedia org w index php title Usenet amp oldid 1131951083, wikipedia, wiki, book, books, library,

article

, read, download, free, free download, mp3, video, mp4, 3gp, jpg, jpeg, gif, png, picture, music, song, movie, book, game, games.