Difference between revisions of "Lambda calculus"

From apm
Jump to: navigation, search
m (Related)
 
(14 intermediate revisions by the same user not shown)
Line 1: Line 1:
 
  '''[[Lambda calculus]]''' – it's basic rules are unbelievably simple and it can compute anything and everything =
 
  '''[[Lambda calculus]]''' – it's basic rules are unbelievably simple and it can compute anything and everything =
  
Lambda diagrams are a way to visualize lambda calculus. <br>
+
[[Lambda diagram]]s are a way to visualize lambda calculus. <br>
 
Lambda calculus is an extremely simple formalism that is equally expressive to the (much more widely known) Turing machine. <br>
 
Lambda calculus is an extremely simple formalism that is equally expressive to the (much more widely known) Turing machine. <br>
 
That is: Lambda calculus is "Turing complete". <br>
 
That is: Lambda calculus is "Turing complete". <br>
Line 35: Line 35:
 
Smack in the middle of between textual and visual programming. <br>
 
Smack in the middle of between textual and visual programming. <br>
 
See main page: [[Annotated lambda diagrams]]
 
See main page: [[Annotated lambda diagrams]]
 +
 +
= On the fundamentality of lambda calculus =
  
== Related ==
+
Lambda calculus is without a doubt a very fundamental calculus. <br>
 +
There is no such things as the most fundamental calculus though.
 +
* Unfortunately because we like to seek "perfect" solutions.
 +
* Fortunately because we'll never run out of new "miracles".
  
* {{speculativity warning}} – [[The program that constructs and executes all possible programs]]
+
== Turing machine seems less fundamental ==
 +
 
 +
The equally expressive truing machine model with
 +
* unboundedly long memory tape and
 +
* finite table of rules
 +
certainly seems less fundamental than the lambda calculus.<br>
 +
In that a concrete implementation of the model is less elegant and less amenable to mathematical handling.
 +
 
 +
== "Overloading" lambda calculus ==
 +
 
 +
Lambda calculus can be abstracted over by an category theory based interpretation. <br>
 +
See: [[Compiling to categories (Conal Elliott)]] <br>
 +
It's kinda like overloading the meaning of function application and ...
 +
 
 +
== Equivalent calculi ==
 +
 
 +
There are other calculi equivalent in expressiveness like e.g. the SKI calculus. <br>
 +
Maybe less intuitive though. While identical programs (same fixed points) can be represented, they differ in run-times. <br>
 +
(Interestingly conversion between calculi in general is a hard problem)
 +
 
 +
== Similar but different calculi ==
 +
 
 +
There are other calculi that are similarly sparse in rules like e.g. the pi-calculus. <br>
 +
{{wikitodo|Look into this again – is the property of mathematical substitutability given?}}
 +
 
 +
== Functional vs Relational ==
 +
 
 +
Lambda calculus is modelling functional relationships not relational relationsships. <br>
 +
There is a directionality in functional relationships while there is none in relational relationships. <br>
 +
Evaluation needs a direction to proceed so this kinda makes sense maybe?
 +
 
 +
== Variable names / indices ==
 +
 
 +
When using names for bound variables then terms that are syntactically different (that is: not written out the same) <br>
 +
are not necessarily semantically different (that is: they may still mean the same). <br>
 +
This is because the exact same structure can use different names for the variables. <br>
 +
Also when there are reused variable names(shadowing) then evaluation by substitution-of-variables-by-their-definition (aka β-reduction) <br>
 +
can lead to name collisions that must be resolved by renaming (aka α-conversion). <br>
 +
This is all additional bookkeeping only leading to additional computational load.
 +
 
 +
One thus desires to represent the terms of lambda calculus without naming the bound variables. <br>
 +
A natural way to do so is by using so called '''de Brujin indices'''. <br>
 +
 
 +
A de Brujin index is a whole positve number at the location of a variable that represents <br>
 +
how many nested surrounding binders one needs to jump over to reach the binder for the variable <br>
 +
In a way '''a de Brujin index specifies The disrete degree of non-locality.'''
 +
 
 +
De Brujin indices are hard to manually operate by human mind though as ...
 +
* they can change during β-reductions and
 +
* binders do not carry visually matchable value names
 +
 
 +
----
 +
 
 +
Note that there is '''yet another quite interesting approach in naming/indexing variables.''' See: <br>
 +
* External link: [https://pchiusano.github.io/2014-06-20/simple-debruijn-alternative.htm A simple alternative to De Bruijn indexing, from ICFP 2013 - blogpost by Paul Chiusano] <br>
 +
* Paper: [https://emilaxelsson.github.io/documents/axelsson2013using.pdf Using Circular Programs for Higher-Order Syntax (Functional pearl) by Emil Axelsson Koen Claessen]
 +
For this to work deferred/lazy evaluation is a necessary prerequisite. <br>
 +
Also when (unlike untyped lambda calculus) types are involved it's possible to run into occurs check issues.
 +
 
 +
It gives higher order abstract syntax (HOAS) for constructing terms, while retaining a simple first-order representation.
 +
 
 +
= Related =
 +
 
 +
* [[Annotated lambda diagram]]s
 +
* [[Annotated lambda diagram mockups]]
 +
* [[Lambda diagram]]s
 +
* [[Compiling to categories (Conal Elliott)]]
 +
* {{speculativity warning}} <br>– [[The program of all programs (code)]] <br>– [[The program that constructs and executes all possible programs]]
 +
 
 +
= External links =
 +
 
 +
* [https://en.wikipedia.org/wiki/Lambda_calculus Lambda calculus]
 +
* [https://en.wikipedia.org/wiki/Lambda_calculus#%CE%B1-conversion Wikipedia: Alpha conversions (in lambda calculus)]
 +
* [https://en.wikipedia.org/wiki/De_Bruijn_index De_Bruijn_index]
 +
* [https://en.wikipedia.org/wiki/Higher-order_abstract_syntax Higher-order abstract syntax]
 +
* https://ncatlab.org/nlab/show/lambda-calculus
 +
----
 +
* [https://en.wikipedia.org/wiki/Turing_machine Turingmachine]
 +
* [https://en.wikipedia.org/wiki/SKI_combinator_calculus SKI combinator calculus], [https://en.wikipedia.org/wiki/B,_C,_K,_W_system B, C, K, W system]
 +
----
 +
* Very different: [https://en.wikipedia.org/wiki/%CE%A0-calculus π-calculus]
 +
----
 +
* Another representation: http://conal.net/papers/compiling-to-categories/

Latest revision as of 18:05, 3 October 2022

Lambda calculus – it's basic rules are unbelievably simple and it can compute anything and everything =

Lambda diagrams are a way to visualize lambda calculus.
Lambda calculus is an extremely simple formalism that is equally expressive to the (much more widely known) Turing machine.
That is: Lambda calculus is "Turing complete".
Any program that is in principle logically possible can be written in Lambda calculus.
A maximally universal computer. At least that is what is the current (2021) consensus on the topic.

The special thing about lambda calculus is that:
Lambda calculus is used very much unchanged as the core of a number of practical programming languages.
Perhaps more so than the Truing machine is.
("practical programming languages" meaning programming languages that are in use in practical applications to a quite notable degree.)

Graphical visualizations for lambda calculus

There are a number of graphical visualizations for Lambda calculus.
The most straightforward one is just to plot out the syntax tree.
There are only three types of elements in the syntax tree of lambda calculus:

  • abstractions
  • applications
  • variables

It's as simple as that.
Well, adding evaluation strategies and a type system makes it a bit more complicated.
But that is the basic gist.

Plain lambda diagrams (PLDs)

An especially nice visualization for lambda calculus are (unannotated) "lambda diagrams".
These are presented by John Tromp on his homepage here: https://tromp.github.io/cl/diagrams.html

Annotated lambda diagrams (ALDs)

Adding some annotations to lambda diagrams may make these into an amazing programming interface with some awesome properties.
Smack in the middle of between textual and visual programming.
See main page: Annotated lambda diagrams

On the fundamentality of lambda calculus

Lambda calculus is without a doubt a very fundamental calculus.
There is no such things as the most fundamental calculus though.

  • Unfortunately because we like to seek "perfect" solutions.
  • Fortunately because we'll never run out of new "miracles".

Turing machine seems less fundamental

The equally expressive truing machine model with

  • unboundedly long memory tape and
  • finite table of rules

certainly seems less fundamental than the lambda calculus.
In that a concrete implementation of the model is less elegant and less amenable to mathematical handling.

"Overloading" lambda calculus

Lambda calculus can be abstracted over by an category theory based interpretation.
See: Compiling to categories (Conal Elliott)
It's kinda like overloading the meaning of function application and ...

Equivalent calculi

There are other calculi equivalent in expressiveness like e.g. the SKI calculus.
Maybe less intuitive though. While identical programs (same fixed points) can be represented, they differ in run-times.
(Interestingly conversion between calculi in general is a hard problem)

Similar but different calculi

There are other calculi that are similarly sparse in rules like e.g. the pi-calculus.
(wiki-TODO: Look into this again – is the property of mathematical substitutability given?)

Functional vs Relational

Lambda calculus is modelling functional relationships not relational relationsships.
There is a directionality in functional relationships while there is none in relational relationships.
Evaluation needs a direction to proceed so this kinda makes sense maybe?

Variable names / indices

When using names for bound variables then terms that are syntactically different (that is: not written out the same)
are not necessarily semantically different (that is: they may still mean the same).
This is because the exact same structure can use different names for the variables.
Also when there are reused variable names(shadowing) then evaluation by substitution-of-variables-by-their-definition (aka β-reduction)
can lead to name collisions that must be resolved by renaming (aka α-conversion).
This is all additional bookkeeping only leading to additional computational load.

One thus desires to represent the terms of lambda calculus without naming the bound variables.
A natural way to do so is by using so called de Brujin indices.

A de Brujin index is a whole positve number at the location of a variable that represents
how many nested surrounding binders one needs to jump over to reach the binder for the variable
In a way a de Brujin index specifies The disrete degree of non-locality.

De Brujin indices are hard to manually operate by human mind though as ...

  • they can change during β-reductions and
  • binders do not carry visually matchable value names

Note that there is yet another quite interesting approach in naming/indexing variables. See:

For this to work deferred/lazy evaluation is a necessary prerequisite.
Also when (unlike untyped lambda calculus) types are involved it's possible to run into occurs check issues.

It gives higher order abstract syntax (HOAS) for constructing terms, while retaining a simple first-order representation.

Related

External links