Difference between revisions of "Multiplication Algorithms"

From Department of Mathematics at UTSA
Jump to navigation Jump to search
 
(One intermediate revision by the same user not shown)
Line 224: Line 224:
 
The product of non-negative integers can be defined with set theory using cardinal numbers or the Peano axioms. See below how to extend this to multiplying arbitrary integers, and then arbitrary rational numbers. The product of real numbers is defined in terms of products of rational numbers; see construction of the real numbers.
 
The product of non-negative integers can be defined with set theory using cardinal numbers or the Peano axioms. See below how to extend this to multiplying arbitrary integers, and then arbitrary rational numbers. The product of real numbers is defined in terms of products of rational numbers; see construction of the real numbers.
  
==Multiplication in group theory==<!--linked from below-->
+
==Multiplication in group theory==
There are many sets that, under the operation of multiplication, satisfy the axioms that define [[group (mathematics)|group]] structure. These axioms are closure, associativity, and the inclusion of an identity element and inverses.
+
There are many sets that, under the operation of multiplication, satisfy the axioms that define group structure. These axioms are closure, associativity, and the inclusion of an identity element and inverses.
  
A simple example is the set of non-zero [[rational numbers]]. Here we have identity 1, as opposed to groups under addition where the identity is typically 0. Note that with the rationals, we must exclude zero because, under multiplication, it does not have an inverse: there is no rational number that can be multiplied by zero to result in 1. In this example, we have an [[abelian group]], but that is not always the case.
+
A simple example is the set of non-zero rational numbers. Here we have identity 1, as opposed to groups under addition where the identity is typically 0. Note that with the rationals, we must exclude zero because, under multiplication, it does not have an inverse: there is no rational number that can be multiplied by zero to result in 1. In this example, we have an abelian group, but that is not always the case.
  
To see this, consider the set of invertible square matrices of a given dimension over a given [[field (mathematics)|field]]. Here, it is straightforward to verify closure, associativity, and inclusion of identity (the [[identity matrix]]) and inverses. However, matrix multiplication is not commutative, which shows that this group is non-abelian.
+
To see this, consider the set of invertible square matrices of a given dimension over a given field. Here, it is straightforward to verify closure, associativity, and inclusion of identity (the identity matrix) and inverses. However, matrix multiplication is not commutative, which shows that this group is non-abelian.
  
 
Another fact worth noticing is that the integers under multiplication do not form a group—even if we exclude zero. This is easily seen by the nonexistence of an inverse for all elements other than 1 and&nbsp;−1.
 
Another fact worth noticing is that the integers under multiplication do not form a group—even if we exclude zero. This is easily seen by the nonexistence of an inverse for all elements other than 1 and&nbsp;−1.
Line 244: Line 244:
 
:The same sign rules apply to rational and real numbers.
 
:The same sign rules apply to rational and real numbers.
  
;[[Rational number]]s
+
;Rational numbers
 
:Generalization to fractions <math>\frac{A}{B}\times \frac{C}{D}</math> is by multiplying the numerators and denominators respectively: <math>\frac{A}{B}\times \frac{C}{D} = \frac{(A\times C)}{(B\times D)}</math>. This gives the area of a rectangle <math>\frac{A}{B}</math> high and <math>\frac{C}{D}</math> wide, and is the same as the number of things in an array when the rational numbers happen to be whole numbers.
 
:Generalization to fractions <math>\frac{A}{B}\times \frac{C}{D}</math> is by multiplying the numerators and denominators respectively: <math>\frac{A}{B}\times \frac{C}{D} = \frac{(A\times C)}{(B\times D)}</math>. This gives the area of a rectangle <math>\frac{A}{B}</math> high and <math>\frac{C}{D}</math> wide, and is the same as the number of things in an array when the rational numbers happen to be whole numbers.
  
;[[Real number]]s
+
;Real numbers
 
:Real numbers and their products can be defined in terms of sequences of rational numbers.
 
:Real numbers and their products can be defined in terms of sequences of rational numbers.
  
;[[Complex number]]s
+
;Complex numbers
 
:Considering complex numbers <math>z_1</math> and <math>z_2</math> as ordered pairs of real numbers <math>(a_1, b_1)</math> and <math>(a_2, b_2)</math>, the product <math>z_1\times z_2</math> is <math>(a_1\times a_2 - b_1\times b_2, a_1\times b_2 + a_2\times b_1)</math>. This is the same as for reals <math>a_1\times a_2</math> when the ''imaginary parts'' <math>b_1</math> and <math>b_2</math> are zero.
 
:Considering complex numbers <math>z_1</math> and <math>z_2</math> as ordered pairs of real numbers <math>(a_1, b_1)</math> and <math>(a_2, b_2)</math>, the product <math>z_1\times z_2</math> is <math>(a_1\times a_2 - b_1\times b_2, a_1\times b_2 + a_2\times b_1)</math>. This is the same as for reals <math>a_1\times a_2</math> when the ''imaginary parts'' <math>b_1</math> and <math>b_2</math> are zero.
  
 
:Equivalently, denoting <math>\sqrt{-1}</math> as <math>i</math>, we have <math>z_1 \times z_2 = (a_1+b_1i)(a_2+b_2i)=(a_1 \times a_2)+(a_1\times b_2i)+(b_1\times a_2i)+(b_1\times b_2i^2)=(a_1a_2-b_1b_2)+(a_1b_2+b_1a_2)i.</math>
 
:Equivalently, denoting <math>\sqrt{-1}</math> as <math>i</math>, we have <math>z_1 \times z_2 = (a_1+b_1i)(a_2+b_2i)=(a_1 \times a_2)+(a_1\times b_2i)+(b_1\times a_2i)+(b_1\times b_2i^2)=(a_1a_2-b_1b_2)+(a_1b_2+b_1a_2)i.</math>
:Alternatively, in trigonometric form, if <math>z_1 = r_1(\cos\phi_1+i\sin\phi_1), z_2 = r_2(\cos\phi_2+i\sin\phi_2)</math>, then<math display="inline">z_1z_2 = r_1r_2(\cos(\phi_1 + \phi_2) + i\sin(\phi_1 + \phi_2)).</math><ref name=":0">{{Cite web|title=Multiplication - Encyclopedia of Mathematics|url=https://encyclopediaofmath.org/wiki/Multiplication|access-date=2021-12-29|website=encyclopediaofmath.org}}</ref>
+
:Alternatively, in trigonometric form, if <math>z_1 = r_1(\cos\phi_1+i\sin\phi_1), z_2 = r_2(\cos\phi_2+i\sin\phi_2)</math>, then<math display="inline">z_1z_2 = r_1r_2(\cos(\phi_1 + \phi_2) + i\sin(\phi_1 + \phi_2)).</math>
  
 
;Further generalizations
 
;Further generalizations

Latest revision as of 14:44, 8 January 2022

Four bags with three marbles per bag gives twelve marbles (4 × 3 = 12).
Multiplication can also be thought of as scaling. Here we see 2 being multiplied by 3 using scaling, giving 6 as a result.
Animation for the multiplication 2 × 3 = 6.
4 × 5 = 20. The large rectangle is made up of 20 squares, each 1 unit by 1 unit.
Area of a cloth 4.5m × 2.5m = 11.25m2;

Multiplication (often denoted by the cross symbol ×, by the mid-line dot operator , by juxtaposition, or, on computers, by an asterisk *) is one of the four elementary mathematical operations of arithmetic, with the other ones being addition, subtraction, and division. The result of a multiplication operation is called a product.

The multiplication of whole numbers may be thought of as repeated addition; that is, the multiplication of two numbers is equivalent to adding as many copies of one of them, the multiplicand, as the quantity of the other one, the multiplier. Both numbers can be referred to as factors.

For example, 4 multiplied by 3, often written as and spoken as "3 times 4", can be calculated by adding 3 copies of 4 together:

Here, 3 (the multiplier) and 4 (the multiplicand) are the factors, and 12 is the product.

One of the main properties of multiplication is the commutative property, which states in this case that adding 3 copies of 4 gives the same result as adding 4 copies of 3:

Thus the designation of multiplier and multiplicand does not affect the result of the multiplication.

Systematic generalizations of this basic definition define the multiplication of integers (including negative numbers), rational numbers (fractions), and real numbers.

Multiplication can also be visualized as counting objects arranged in a rectangle (for whole numbers) or as finding the area of a rectangle whose sides have some given lengths. The area of a rectangle does not depend on which side is measured first—a consequence of the commutative property.

The product of two measurements is a new type of measurement. For example, multiplying the lengths of the two sides of a rectangle gives its area. Such a product is the subject of dimensional analysis.

The inverse operation of multiplication is division. For example, since 4 multiplied by 3 equals 12, 12 divided by 3 equals 4. Indeed, multiplication by 3, followed by division by 3, yields the original number. The division of a number other than 0 by itself equals 1.

Multiplication is also defined for other types of numbers, such as complex numbers, and for more abstract constructs, like matrices. For some of these more abstract constructs, the order in which the operands are multiplied together matters. A listing of the many different kinds of products used in mathematics is given in Product (mathematics).

Notation and terminology

In arithmetic, multiplication is often written using the multiplication sign (either × or ) between the terms (that is, in infix notation). For example,

("two times three equals six")

There are other mathematical notations for multiplication:

  • To reduce confusion between the multiplication sign × and the common variable x, multiplication is also denoted by dot signs, usually a middle-position dot (rarely period):
5 ⋅ 2 or 5 . 3
The middle dot notation, encoded in Unicode as U+22C5 ⋅ DOT OPERATOR, is now standard in the United States and other countries where the period is used as a decimal point. When the dot operator character is not accessible, the interpunct (·) is used. In other countries that use a comma as a decimal mark, either the period or a middle dot is used for multiplication.
Historically, in the United Kingdom and Ireland, the middle dot was sometimes used for the decimal to prevent it from disappearing in the ruled line, and the period/full stop was used for multiplication. However, since the Ministry of Technology ruled to use the period as the decimal point in 1968, and the SI standard has since been widely adopted, this usage is now found only in the more traditional journals such as The Lancet.
  • In algebra, multiplication involving variables is often written as a juxtaposition (e.g., xy for x times y or 5x for five times x), also called implied multiplication. The notation can also be used for quantities that are surrounded by parentheses (e.g., 5(2) or (5)(2) for five times two). This implicit usage of multiplication can cause ambiguity when the concatenated variables happen to match the name of another variable, when a variable name in front of a parenthesis can be confused with a function name, or in the correct determination of the order of operations.
  • In vector multiplication, there is a distinction between the cross and the dot symbols. The cross symbol generally denotes the taking a cross product of two vectors, yielding a vector as its result, while the dot denotes taking the dot product of two vectors, resulting in a scalar.

In computer programming, the asterisk (as in 5*2) is still the most common notation. This is due to the fact that most computers historically were limited to small character sets (such as ASCII and EBCDIC) that lacked a multiplication sign (such as or ×), while the asterisk appeared on every keyboard. This usage originated in the FORTRAN programming language.

The numbers to be multiplied are generally called the "factors". The number to be multiplied is the "multiplicand", and the number by which it is multiplied is the "multiplier". Usually, the multiplier is placed first and the multiplicand is placed second; however sometimes the first factor is the multiplicand and the second the multiplier. Also, as the result of multiplication does not depend on the order of the factors, the distinction between "multiplicand" and "multiplier" is useful only at a very elementary level and in some multiplication algorithms, such as the long multiplication. Therefore, in some sources, the term "multiplicand" is regarded as a synonym for "factor". In algebra, a number that is the multiplier of a variable or expression (e.g., the 3 in 3xy2) is called a coefficient.

The result of a multiplication is called a product. When one factor is an integer, the product is a multiple of the other or of the product of the others. Thus is a multiple of , as is . A product of integers is a multiple of each factor; for example, 15 is the product of 3 and 5 and is both a multiple of 3 and a multiple of 5.

Computation

The Educated Monkey – a tin toy dated 1918, used as a multiplication "calculator". For example: set the monkey's feet to 4 and 9, and get the product – 36 – in its hands.

Many common methods for multiplying numbers using pencil and paper require a multiplication table of memorized or consulted products of small numbers (typically any two numbers from 0 to 9). However, one method, the peasant multiplication algorithm, does not. The example below illustrates "long multiplication" (the "standard algorithm", "grade-school multiplication"):

      23958233
×         5830
———————————————
      00000000 ( =      23,958,233 ×     0)
     71874699  ( =      23,958,233 ×    30)
   191665864   ( =      23,958,233 ×   800)
+ 119791165    ( =      23,958,233 × 5,000)
———————————————
  139676498390 ( = 139,676,498,390        )

Multiplying numbers to more than a couple of decimal places by hand is tedious and error-prone. Common logarithms were invented to simplify such calculations, since adding logarithms is equivalent to multiplying. The slide rule allowed numbers to be quickly multiplied to about three places of accuracy. Beginning in the early 20th century, mechanical calculators, such as the Marchant, automated multiplication of up to 10-digit numbers. Modern electronic computers and calculators have greatly reduced the need for multiplication by hand.

Historical algorithms

Methods of multiplication were documented in the writings of ancient Egyptian, Greek, Indian, and Chinese civilizations.

The Ishango bone, dated to about 18,000 to 20,000 BC, may hint at a knowledge of multiplication in the Upper Paleolithic era in Central Africa, but this is speculative.

Egyptians

The Egyptian method of multiplication of integers and fractions, which is documented in the Rhind Mathematical Papyrus, was by successive additions and doubling. For instance, to find the product of 13 and 21 one had to double 21 three times, obtaining 2 × 21 = 42, 4 × 21 = 2 × 42 = 84, 8 × 21 = 2 × 84 = 168. The full product could then be found by adding the appropriate terms found in the doubling sequence:

13 × 21 = (1 + 4 + 8) × 21 = (1 × 21) + (4 × 21) + (8 × 21) = 21 + 84 + 168 = 273.

Babylonians

The Babylonians used a sexagesimal positional number system, analogous to the modern-day decimal system. Thus, Babylonian multiplication was very similar to modern decimal multiplication. Because of the relative difficulty of remembering 60 × 60 different products, Babylonian mathematicians employed multiplication tables. These tables consisted of a list of the first twenty multiples of a certain principal number n: n, 2n, ..., 20n; followed by the multiples of 10n: 30n 40n, and 50n. Then to compute any sexagesimal product, say 53n, one only needed to add 50n and 3n computed from the table.

Chinese

38 × 76 = 2888

In the mathematical text Zhoubi Suanjing, dated prior to 300 BC, and the Nine Chapters on the Mathematical Art, multiplication calculations were written out in words, although the early Chinese mathematicians employed Rod calculus involving place value addition, subtraction, multiplication, and division. The Chinese were already using a decimal multiplication table by the end of the Warring States period.

Modern methods

Product of 45 and 256. Note the order of the numerals in 45 is reversed down the left column. The carry step of the multiplication can be performed at the final stage of the calculation (in bold), returning the final product of 45 × 256 = 11520. This is a variant of Lattice multiplication.

The modern method of multiplication based on the Hindu–Arabic numeral system was first described by Brahmagupta. Brahmagupta gave rules for addition, subtraction, multiplication, and division. Henry Burchard Fine, then a professor of mathematics at Princeton University, wrote the following:

The Indians are the inventors not only of the positional decimal system itself, but of most of the processes involved in elementary reckoning with the system. Addition and subtraction they performed quite as they are performed nowadays; multiplication they effected in many ways, ours among them, but division they did cumbrously.

These place value decimal arithmetic algorithms were introduced to Arab countries by Al Khwarizmi in the early 9th century and popularized in the Western world by Fibonacci in the 13th century.

Grid method

Grid method multiplication, or the box method, is used in primary schools in England and Wales and in some areas of the United States to help teach an understanding of how multiple digit multiplication works. An example of multiplying 34 by 13 would be to lay the numbers out in a grid as follows:

  30 4
10 300 40
3 90 12

and then add the entries.

Computer algorithms

The classical method of multiplying two n-digit numbers requires n2 digit multiplications. Multiplication algorithms have been designed that reduce the computation time considerably when multiplying large numbers. Methods based on the discrete Fourier transform reduce the computational complexity to O(n log n log log n). In 2016, the factor log log n was replaced by a function that increases much slower, though still not constant. In March 2019, David Harvey and Joris van der Hoeven submitted a paper presenting an integer multiplication algorithm with a complexity of The algorithm, also based on the fast Fourier transform, is conjectured to be asymptotically optimal. The algorithm is not practically useful, as it only becomes faster for multiplying extremely large numbers (having more than 2172912 bits).

Products of measurements

One can only meaningfully add or subtract quantities of the same type, but quantities of different types can be multiplied or divided without problems. For example, four bags with three marbles each can be thought of as:

[4 bags] × [3 marbles per bag] = 12 marbles.

When two measurements are multiplied together, the product is of a type depending on the types of measurements. The general theory is given by dimensional analysis. This analysis is routinely applied in physics, but it also has applications in finance and other applied fields.

A common example in physics is the fact that multiplying speed by time gives distance. For example:

50 kilometers per hour × 3 hours = 150 kilometers.

In this case, the hour units cancel out, leaving the product with only kilometer units.

Other examples of multiplication involving units include:

2.5 meters × 4.5 meters = 11.25 square meters
11 meters/seconds × 9 seconds = 99 meters
4.5 residents per house × 20 houses = 90 residents

Product of a sequence

Capital pi notation

The product of a sequence of factors can be written with the product symbol, which derives from the capital letter (pi) in the Greek alphabet (much like the same way the capital letter (sigma) is used in the context of summation). Unicode position U+220F ∏ contains a glyph for denoting such a product, distinct from U+03A0 Π, the letter. The meaning of this notation is given by:

that is

The subscript gives the symbol for a bound variable (i in this case), called the "index of multiplication", together with its lower bound (1), whereas the superscript (here 4) gives its upper bound. The lower and upper bound are expressions denoting integers. The factors of the product are obtained by taking the expression following the product operator, with successive integer values substituted for the index of multiplication, starting from the lower bound and incremented by 1 up to (and including) the upper bound. For example:

More generally, the notation is defined as

where m and n are integers or expressions that evaluate to integers. In the case where m = n, the value of the product is the same as that of the single factor xm; if m > n, the product is an empty product whose value is 1—regardless of the expression for the factors.

Properties of capital pi notation

By definition,

If all factors are identical, a product of n factors is equivalent to exponentiation:

Associativity and commutativity of multiplication imply

and

if a is a nonnegative integer, or if all are positive real numbers, and

if all are nonnegative integers, or if x is a positive real number.

Infinite products

One may also consider products of infinitely many terms; these are called infinite products. Notationally, this consists in replacing n above by the Infinity symbol ∞. The product of such an infinite sequence is defined as the limit of the product of the first n terms, as n grows without bound. That is,

One can similarly replace m with negative infinity, and define:

provided both limits exist.

Properties

Multiplication of numbers 0–10. Line labels = multiplicand. X-axis = multiplier. Y-axis = product.
Extension of this pattern into other quadrants gives the reason why a negative number times a negative number yields a positive number.
Note also how multiplication by zero causes a reduction in dimensionality, as does multiplication by a singular matrix where the determinant is 0. In this process, information is lost and cannot be regained.

For real and complex numbers, which includes, for example, natural numbers, integers, and fractions, multiplication has certain properties:

Commutative property
The order in which two numbers are multiplied does not matter:
Associative property
Expressions solely involving multiplication or addition are invariant with respect to the order of operations:
Distributive property
Holds with respect to multiplication over addition. This identity is of prime importance in simplifying algebraic expressions:
Identity element
The multiplicative identity is 1; anything multiplied by 1 is itself. This feature of 1 is known as the identity property:
Property of 0
Any number multiplied by 0 is 0. This is known as the zero property of multiplication:
Negation
−1 times any number is equal to the additive inverse of that number.
where
–1 times –1 is 1.
Inverse element
Every number x, except 0, has a multiplicative inverse, , such that .
Order preservation
Multiplication by a positive number preserves the order:
For a > 0, if b > c then ab > ac.
Multiplication by a negative number reverses the order:
For a < 0, if b > c then ab < ac.
The complex numbers do not have an ordering that is compatible with both addition and multiplication.

Other mathematical systems that include a multiplication operation may not have all these properties. For example, multiplication is not, in general, commutative for matrices and quaternions.

Axioms

In the book Arithmetices principia, nova methodo exposita, Giuseppe Peano proposed axioms for arithmetic based on his axioms for natural numbers. Peano arithmetic has two axioms for multiplication:

Here S(y) represents the successor of y; i.e., the natural number that follows y. The various properties like associativity can be proved from these and the other axioms of Peano arithmetic, including induction. For instance, S(0), denoted by 1, is a multiplicative identity because

The axioms for integers typically define them as equivalence classes of ordered pairs of natural numbers. The model is based on treating (x,y) as equivalent to xy when x and y are treated as integers. Thus both (0,1) and (1,2) are equivalent to −1. The multiplication axiom for integers defined this way is

The rule that −1 × −1 = 1 can then be deduced from

Multiplication is extended in a similar way to rational numbers and then to real numbers.

Multiplication with set theory

The product of non-negative integers can be defined with set theory using cardinal numbers or the Peano axioms. See below how to extend this to multiplying arbitrary integers, and then arbitrary rational numbers. The product of real numbers is defined in terms of products of rational numbers; see construction of the real numbers.

Multiplication in group theory

There are many sets that, under the operation of multiplication, satisfy the axioms that define group structure. These axioms are closure, associativity, and the inclusion of an identity element and inverses.

A simple example is the set of non-zero rational numbers. Here we have identity 1, as opposed to groups under addition where the identity is typically 0. Note that with the rationals, we must exclude zero because, under multiplication, it does not have an inverse: there is no rational number that can be multiplied by zero to result in 1. In this example, we have an abelian group, but that is not always the case.

To see this, consider the set of invertible square matrices of a given dimension over a given field. Here, it is straightforward to verify closure, associativity, and inclusion of identity (the identity matrix) and inverses. However, matrix multiplication is not commutative, which shows that this group is non-abelian.

Another fact worth noticing is that the integers under multiplication do not form a group—even if we exclude zero. This is easily seen by the nonexistence of an inverse for all elements other than 1 and −1.

Multiplication in group theory is typically notated either by a dot or by juxtaposition (the omission of an operation symbol between elements). So multiplying element a by element b could be notated as a b or ab. When referring to a group via the indication of the set and operation, the dot is used. For example, our first example could be indicated by .

Multiplication of different kinds of numbers

Numbers can count (3 apples), order (the 3rd apple), or measure (3.5 feet high); as the history of mathematics has progressed from counting on our fingers to modelling quantum mechanics, multiplication has been generalized to more complicated and abstract types of numbers, and to things that are not numbers (such as matrices) or do not look much like numbers (such as quaternions).

Integers
is the sum of N copies of M when N and M are positive whole numbers. This gives the number of things in an array N wide and M high. Generalization to negative numbers can be done by
and
The same sign rules apply to rational and real numbers.
Rational numbers
Generalization to fractions is by multiplying the numerators and denominators respectively: . This gives the area of a rectangle high and wide, and is the same as the number of things in an array when the rational numbers happen to be whole numbers.
Real numbers
Real numbers and their products can be defined in terms of sequences of rational numbers.
Complex numbers
Considering complex numbers and as ordered pairs of real numbers and , the product is . This is the same as for reals when the imaginary parts and are zero.
Equivalently, denoting as , we have
Alternatively, in trigonometric form, if , then
Further generalizations
See Multiplication in group theory, above, and Multiplicative group, which for example includes matrix multiplication. A very general, and abstract, concept of multiplication is as the "multiplicatively denoted" (second) binary operation in a ring. An example of a ring that is not any of the above number systems is a polynomial ring (you can add and multiply polynomials, but polynomials are not numbers in any usual sense.)
Division
Often division, , is the same as multiplication by an inverse, . Multiplication for some types of "numbers" may have corresponding division, without inverses; in an integral domain x may have no inverse "" but may be defined. In a division ring there are inverses, but may be ambiguous in non-commutative rings since need not be the same as .

Exponentiation

When multiplication is repeated, the resulting operation is known as exponentiation. For instance, the product of three factors of two (2×2×2) is "two raised to the third power", and is denoted by 23, a two with a superscript three. In this example, the number two is the base, and three is the exponent. In general, the exponent (or superscript) indicates how many times the base appears in the expression, so that the expression

indicates that n copies of the base a are to be multiplied together. This notation can be used whenever multiplication is known to be power associative.

Licensing

Content obtained and/or adapted from: