Yacc

Yacc (Yet Another Compiler-Compiler) is a computer program for the Unix operating system developed by Stephen C. Johnson. It is a lookahead left-to-right rightmost derivation (LALR) parser generator, generating a LALR parser (the part of a compiler that tries to make syntactic sense of the source code) based on a formal grammar, written in a notation similar to Backus–Naur form (BNF).^[1] Yacc is supplied as a standard utility on BSD and AT&T Unix.^[2] GNU-based Linux distributions include Bison, a forward-compatible Yacc replacement.^[3]

Yacc

Original author(s)	Stephen C. Johnson
Repository	www.tuhs.org/cgi-bin/utree.pl?file=V6%2Fusr%2Fsource%2Fyacc
Written in	C
Operating system	Unix, Unix-like, Plan 9, Inferno
Platform	Cross-platform
Type	Command
License	Plan 9: MIT License

History

In the early 1970s, Stephen C. Johnson, a computer scientist at Bell Labs / AT&T, developed Yacc because he wanted to insert an exclusive or operator into a B language compiler^[4] (developed using McIlroy's TMG compiler-compiler^[5]), but it turned out to be a hard task. As a result, he was directed by his colleague at Bell Labs Al Aho to Donald Knuth's work on LR parsing, which served as the basis for Yacc.^[4] Yacc was influenced by^[6] and received its name in reference to TMG compiler-compiler.^[7]

Yacc was originally written in the B programming language, but was soon rewritten in C by Alan Snyder.^[5] It appeared as part of Version 3 Unix,^[8] and a full description of Yacc was published in 1975.^[6]

Johnson used Yacc to create the Portable C Compiler.^[8] Bjarne Stroustrup also attempted to use Yacc to create a formal specification of C++, but "was defeated by C's syntax".^[9] While finding it unsuitable for a formal specification of the language, Stroustrup did proceed to use Yacc to implement Cfront, the first implementation of C++.^[10]

In a 2008 interview, Johnson reflected that "the contribution Yacc made to the spread of Unix and C is what I'm proudest of".^[11]

Description

The input to Yacc is a grammar with snippets of C code (called "actions") attached to its rules. Its output is a shift-reduce parser in C that executes the C snippets associated with each rule as soon as the rule is recognized. Typical actions involve the construction of parse trees. Using an example from Johnson, if the call node(label, left, right) constructs a binary parse tree node with the specified label and children, then the rule

expr : expr '+' expr { $$ = node('+', $1, $3); } 

recognizes summation expressions and constructs nodes for them. The special identifiers $$, $1 and $3 refer to items on the parser's stack.^[6]

Yacc produces only a parser (phrase analyzer) which can be used alone in the case of scannerless parsing however, full syntactic analysis typically requires an external lexical analyzer to perform a tokenization stage first (word analysis), which is then followed by the parsing stage proper.^[6] Lexical analyzer generators, such as Lex or Flex, are widely available for this purpose. The IEEE POSIX P1003.2 standard defines the functionality and requirements for both Lex and Yacc.^[12]

Some versions of AT&T Yacc have become open source. For example, source code is available with the standard distributions of Plan 9.^[13]

Impact

Yacc and similar programs (largely reimplementations) have been very popular. Yacc itself used to be available as the default parser generator on most Unix systems, though it has since been supplanted by more recent, largely compatible, programs such as Berkeley Yacc, GNU Bison, MKS Yacc, and Abraxas PCYACC. An updated version of the original AT&T Yacc is included as part of Sun's OpenSolaris project. Each offers slight improvements and additional features over the original Yacc, but the concept and basic syntax have remained the same.^[14]

Yacc was also one of several UNIX tools available for Charles River Data Systems' UNOS operating system under Bell Laboratories license.^[15]

Among the languages that were first implemented with Yacc are AWK, C++,^[10] eqn and Pic.^[16] Yacc was also used on Unix to implement the Portable C Compiler, as well as parsers for such programming languages as FORTRAN 77, Ratfor, APL, bc, m4, etc.^[8][17]

Yacc has also been rewritten for other languages, including OCaml,^[18] Ratfor, ML, Ada, Pascal, Java, Python, Ruby, Go,^[19] Common Lisp^[20] and Erlang.^[21]

• Berkeley Yacc: The Berkeley implementation of Yacc quickly became more popular than AT&T Yacc itself because of its performance and lack of reuse restrictions.^[22]
• LALR parser: The underlying parsing algorithm in Yacc-generated parsers.
• Bison: The GNU version of Yacc.
• Lex (and Flex lexical analyser), a token parser commonly used in conjunction with Yacc (and Bison).
• BNF is a metasyntax used to express context-free grammars: that is a formal way to describe context-free languages.
• PLY (Python Lex-Yacc) is an alternative implementation of Lex and Yacc in Python.

See also

• Compiler-compiler
• hoc (programming language)

References

1. . Computerworld. Archived from the original on 31 January 2013. Retrieved 30 November 2012.
2. Levine, John (1992). Lex & yacc. Sebastopol, CA: O'Reilly & Associates. p. xx. ISBN 1-56592-000-7.
3. Levine, John (2009). Flex & bison. Sebastopol, Calif: O'Reilly Media. p. xv. ISBN 978-0-596-15597-1.
4. Morris, Richard (1 October 2009). "Stephen Curtis Johnson: Geek of the Week". Red Gate Software. Retrieved 19 January 2018.
5. Ritchie, Dennis M. (April 1993). "The Development of the C Language". History of programming languages---II. Association for Computing Machinery, Inc. (published 1996-01-01). doi:10.1145/234286.1057834. ISBN 0-201-89502-1. pp. 675, 684: After the TMG version of B was working, Thompson rewrote B in itself(a bootstrapping step).…When Johnson returned to Bell Labs in 1973, he was disconcerted to find that the language whose seeds he had brought to Canada had evolved back home; even his own yacc program had been rewritten in C, by Alan Snyder.
6. Johnson, Stephen C. (1975). Yacc: Yet Another Compiler-Compiler (Technical report). Murray Hill, New Jersey: AT&T Bell Laboratories. 32. Retrieved 31 January 2020.
7. "Early Translator Writing Systems". Atlas Computer Laboratory.
8. McIlroy, M. D. (1987). A Research Unix reader: annotated excerpts from the Programmer's Manual, 1971–1986 (PDF) (Technical report). CSTR. Bell Labs. 139.
9. Stroustrup, Bjarne. "A History of C++: 1979−1991" (PDF).
10. Stroustrup, Bjarne. "Cfront source code".
11. Hamilton, Naomi (2008-07-09). "Yacc, Unix, and advice from Bell Labs alumni Stephen Johnson". www.computerworld.com. from the original on 2020-08-22. Retrieved 2020-11-10.
12. lex – Shell and Utilities Reference, The Single UNIX Specification, Version 4 from The Open Group, yacc – Shell and Utilities Reference, The Single UNIX Specification, Version 4 from The Open Group.
13. "plan9: UC Berkeley release of Plan 9 under the GPLv2". GitHub. 26 December 2017. Retrieved 2 January 2018.
14. Bison Manual: History
15. The Insider's Guide To The Universe (PDF). Charles River Data Systems, Inc. 1983. p. 13.
16. "UNIX Special: Profs Kernighan & Brailsford". Computerphile. September 30, 2015. Archived from the original on 2021-12-11.
17. Kernighan, Brian W.; Pike, Rob (1984). The Unix Programming Environment. Prentice Hall. ISBN 0-13-937681-X.
18. "OCaml User's Manual: Chapter 12 Lexer and parser generators (ocamllex, ocamlyacc)". Retrieved 25 Nov 2013.
19. "Yacc.go: A version of Yacc for the Go Programming Language". Retrieved 15 July 2017.
20. "CL-Yacc: A Common Lisp version of Yacc".
21. "yecc: An Erlang implementation of Yacc".
22. John Levine (August 2009), flex & bison, O'Reilly Media

External links

• Playground environment for learning and testing syntax

 

The Wikibook Guide to Unix has a page on the topic of: Commands

• yacc – Shell and Utilities Reference, The Single UNIX Specification, Version 4 from The Open Group
• yacc(1) – Plan 9 Programmer's Manual, Volume 1
• yacc(1) – Inferno General commands Manual
• yacc(1) – Linux General Commands Manual