Difference between revisions of "Reverse engineering" - New World Encyclopedia

From New World Encyclopedia
(Fixed)
 
(14 intermediate revisions by 5 users not shown)
Line 1: Line 1:
'''Reverse engineering''' (RE) is the process of discovering the technological principles of a device, object or system through analysis of its structure, function and operation. It often involves taking something (e.g. a [[machine|mechanical device]], [[electronic component]], or [[software]] program) apart and analyzing its workings in detail, usually to try to make a new device or program that does the same thing without copying anything from the original.
+
{{Ready}}{{Images OK}}{{Approved}}{{copyedited}}
 
+
'''Reverse engineering''' (RE) is the process of discovering the technological principles of a device, object or system through analysis of its structure, function, and operation. It often involves taking something (for example a [[machine|mechanical device]], [[electronic component]], or [[software]] program) apart and analyzing its workings in detail, usually to try to make a new device or program that does the same thing without copying anything from the original.
 +
{{toc}}
 
==Motivation==
 
==Motivation==
 
Reasons for reverse-engineering:
 
Reasons for reverse-engineering:
* [[interoperability]].
+
* [[Interoperability]]
* lost documentation: Reverse engineering often is done because the documentation of a particular device has been lost (or was never written), and the person who built it is no longer available. Integrated circuits often seem to have been designed on obsolete, proprietary systems, which means that the only way to incorporate the functionality into new technology is to reverse-engineer the existing chip and then re-design it.
+
* Lost documentation: Reverse engineering often is done because the documentation of a particular device has been lost (or was never written), and the person who built it is no longer available. Integrated circuits often seem to have been designed on obsolete, proprietary systems, which means that the only way to incorporate the functionality into new technology is to reverse-engineer the existing chip and then re-design it.
* product analysis. To examine how a product works, what components it consists of, estimate costs, identify potential patent infringement.
+
* Product analysis. To examine how a product works, what components it consists of, estimate costs, identify potential patent infringement.
* security auditing
+
* Security auditing
* removal of copy protection, circumvention of access restrictions.
+
* Removal of copy protection, circumvention of access restrictions.
* creation of unlicensed/unapproved duplicates
+
* Creation of unlicensed/unapproved duplicates
* fraud
+
* Fraud
  
 
==Reverse engineering of mechanical devices==
 
==Reverse engineering of mechanical devices==
As [[computer-aided design]] has become more popular, reverse engineering has become a viable method to create a 3D virtual model of an existing physical part for use in 3D CAD, [[computer-aided manufacturing|CAM]], [[computer-aided engineering|CAE]] and other software<ref>T. Varady, R. R. Martin, J. Cox, Reverse Engineering of Geometric Models—An Introduction, Computer Aided Design 29 (4), 255-268, 1997.
+
As [[computer-aided design]] has become more popular, reverse engineering has become a viable method to create a 3D virtual model of an existing physical part for use in 3D CAD, [[computer-aided manufacturing|CAM]], [[computer-aided engineering|CAE]] and other software.<ref>T. Varady, R.R. Martin, and J. Cox, Reverse Engineering of Geometric Models—An Introduction, ''Computer Aided Design'' 29(4): 255-268.</ref> The reverse engineering process involves measuring an object and then reconstructing it as a 3D model. The physical object can be measured using [[3d scanner|3D scanning]] technologies like [[coordinate-measuring machine|CMMs]], [[3d scanner#Triangulation|laser scanners]], [[3d scanner#Structured light|structured light digitizer]]s, or [[computed tomography]]. The measured data alone, usually represented as a [[point cloud]], lacks topological information and is therefore often processed and modeled into a more usable format such as a triangular faced mesh, a set of [[NURBS]] surfaces or a CAD model.<!--The point clouds themselves are not compatible with most 3D software, so a—> Applications like Imageware, PolyWorks, Rapidform, or Geomagic are used to process the point clouds themselves into formats usable in other applications such as 3D CAD, CAM, CAE or visualization.
</ref>. The reverse engineering process involves measuring an object and then reconstructing it as a 3D model. The physical object can be measured using [[3d scanner|3D scanning]] technologies like [[coordinate-measuring machine|CMMs]], [[3d scanner#Triangulation|laser scanners]], [[3d scanner#Structured light|structured light digitizer]]s or [[computed tomography]]. The measured data alone, usually represented as a [[point cloud]], lacks topological information and is therefore often processed and modeled into a more usable format such as a triangular faced mesh, a set of [[NURBS]] surfaces or a CAD model.<!--The point clouds themselves are not compatible with most 3D software, so a—> Applications like [http://www.ugs.com/products/nx/imageware/ Imageware], [http://www.innovmetric.com PolyWorks], [http://www.Rapidform.com Rapidform] or [http://www.geomagic.com Geomagic] are used to process the point clouds themselves into formats usable in other applications such as 3D CAD, CAM, CAE or visualization.
 
  
 
Reverse engineering is also used by businesses to bring existing physical geometry into digital product development environments, to make a digital 3D record of their own products or assess competitors' products. It is used to analyze, for instance, how a product works, what it does, what components it consists of, estimate costs, identify potential [[patent]] infringement, etc.
 
Reverse engineering is also used by businesses to bring existing physical geometry into digital product development environments, to make a digital 3D record of their own products or assess competitors' products. It is used to analyze, for instance, how a product works, what it does, what components it consists of, estimate costs, identify potential [[patent]] infringement, etc.
  
[[Value engineering]] is a related activity also used by business. It involves deconstructing and analysing products, but the objective is to find opportunities for cost cutting.
+
[[Value engineering]] is a related activity also used by business. It involves deconstructing and analyzing products, but the objective is to find opportunities for cost cutting.
  
 
==Reverse engineering of software==
 
==Reverse engineering of software==
{{wikibooks}}
+
The term "reverse engineering" as applied to software means different things to different people, prompting Chikofsky and Cross to write a paper researching the various uses and defining a [[taxonomy]]. According to them, Reverse engineering is the process of analyzing a subject system to create representations of the system at a higher level of abstraction.<ref>E.J. Chikofsky and J.H. Cross II, Reverse Engineering and Design Recovery: A Taxonomy in IEEE Software, ''IEEE Computer Society'' 13–17.</ref> It can also be seen as "going backwards through the development cycle".<ref>R. Warden, ''Software Reuse and Reverse Engineering in Practice'' (London: Chapman & Hall, 1992, ISBN 9780442314095).</ref> In this model, the output of the implementation phase (in source code form) is reverse engineered back to the analysis phase, in an inversion of the traditional [[waterfall model]]. Reverse engineering is a process of examination only: the software system under consideration is not modified (which would make it [[reengineering (software)|reengineering]]). [[Software anti-tamper]] technology is used to deter both reverse engineering and reengineering of proprietary software and software-powered systems. In practice, two main types of reverse engineering emerge. In the first case, source code is already available for the software, but higher level aspects of the program, perhaps poorly documented or documented but no longer valid, are discovered. In the second case, there is no source code available for the software, and any efforts towards discovering one possible source code for the software are regarded as reverse engineering. This second usage of the term is the one most people are familiar with. Reverse engineering of software can make use of the [[clean room design]] technique to avoid infringing copyrights.
The term "reverse engineering" as applied to software means different things to different people, prompting Chikofsky and Cross to write a paper researching the various uses and defining a [[taxonomy]]. From their paper:<br/>
 
Reverse engineering is the process of analyzing a subject system to create representations of the system at a higher level of abstraction.<ref>{{cite journal | last=Chikofsky | first=E.J. | coauthors=J.H. Cross II | year=1990 | month=January | title=Reverse Engineering and Design Recovery: A Taxonomy in IEEE Software | journal=IEEE Computer Society | pages=13–17}}</ref> It can also be seen as "going backwards through the development cycle".<ref>{{cite book | last=Warden | first=R. | title=Software Reuse and Reverse Engineering in Practice | year=1992 | publisher=Chapman & Hall | location=London, England | pages=283–305}}</ref> In this model, the output of the implementation phase (in source code form) is reverse engineered back to the analysis phase, in an inversion of the traditional [[waterfall model]]. Reverse engineering is a process of examination only: the software system under consideration is not modified (which would make it [[reengineering (software)|reengineering]]). [[Software anti-tamper]] technology is used to deter both reverse engineering and reengineering of proprietary software and software-powered systems. In practice, two main types of reverse engineering emerge. In the first case, source code is already available for the software, but higher level aspects of the program, perhaps poorly documented or documented but no longer valid, are discovered. In the second case, there is no source code available for the software, and any efforts towards discovering one possible source code for the software are regarded as reverse engineering. This second usage of the term is the one most people are familiar with. Reverse engineering of software can make use of the [[clean room design]] technique to avoid infringing copyrights.
 
  
 
On a related note, [[black box testing]] in [[software engineering]] has a lot in common with reverse-engineering. The tester usually has the [[application programming interface|API]], but their goals are to find bugs and undocumented features by bashing the product from outside.
 
On a related note, [[black box testing]] in [[software engineering]] has a lot in common with reverse-engineering. The tester usually has the [[application programming interface|API]], but their goals are to find bugs and undocumented features by bashing the product from outside.
Line 29: Line 27:
  
 
===Binary software===
 
===Binary software===
This process is sometimes termed ''Reverse Code Engineering'' or RCE.<ref>{{cite book | last=Chuvakin | first=Anton | coauthors=Cyrus Peikari | edition=1st ed. | title=Security Warrior | url=http://www.oreilly.com/catalog/swarrior/reviews.html | accessdate=2006-05-25 | publisher=O'Reilly | year=2004 | month=January}}</ref> As an example, decompilation of binaries for the [[Java platform]] can be accomplished using Jad. One famous case of reverse engineering was the first non-[[International Business Machines|IBM]] implementation of the [[IBM PC|PC]] [[BIOS]] which launched the historic [[IBM PC compatible]] industry that has been the overwhelmingly dominant computer hardware platform for many years. An example of a group that reverse engineers software for enjoyment is CORE which stands for "Challenge Of Reverse Engineering." In the [[United States]], the [[Digital Millennium Copyright Act]] exempts from the circumvention ban some acts of reverse engineering aimed at interoperability of file formats and protocols, but judges in key cases have ignored this law, since it is acceptable to circumvent restrictions for use, but not for access.<ref>{{cite web | url=http://www4.law.cornell.edu/uscode/html/uscode17/usc_sec_17_00001201----000-.html | title=US Code: Title 17,1201. Circumvention of copyright protection systems | accessdate=2006-05-25}}</ref> Aside from restrictions on circumvention, reverse engineering of software is protected in the U.S. by the [[fair use]] exception in [[copyright|copyright law]].<ref>See [[Pamela Samuelson]] and Suzanne Scotchmer, "The Law and Economics of Reverse Engineering," 111 ''Yale Law Journal'' 1575-1663 (May 2002).</ref> The [[Samba software]], which allows systems that are not running [[Microsoft Windows]] systems to share files with systems that are, is a classic example of software reverse engineering{{Fact|date=April 2007}}, since the Samba project had to reverse-engineer unpublished information about how Windows file sharing worked, so that non-Windows computers could emulate it. The [[Wine (software)|Wine]] project does the same thing for the [[Windows API]], and [[OpenOffice.org]] is one party doing this for the [[Microsoft Office]] file formats. The [[ReactOS]] project is even more ambitious in its goals as it strives to provide binary (ABI and API) compatibility with the current Windows OSes of the NT branch, allowing software and drivers written for Windows to run on a clean room reverse engineered GPL open source counterpart.
+
This process is sometimes termed ''Reverse Code Engineering'' or RCE.<ref>Anton Chuvakin and Cyrus Peikari, ''Security Warrior'' (Sebastopol, CA: O'Reilly & Associates, Inc., 2004, ISBN 9780596005450).</ref> As an example, decompilation of binaries for the [[Java platform]] can be accomplished using Jad. One famous case of reverse engineering was the first non-[[International Business Machines|IBM]] implementation of the [[IBM PC|PC]] [[BIOS]] which launched the historic [[IBM PC compatible]] industry that has been the overwhelmingly dominant computer hardware platform for many years. An example of a group that reverse engineers software for enjoyment is CORE, which stands for "Challenge Of Reverse Engineering." In the [[United States]], the [[Digital Millennium Copyright Act]] exempts from the circumvention ban some acts of reverse engineering aimed at interoperability of file formats and protocols, but judges in key cases have ignored this law, since it is acceptable to circumvent restrictions for use, but not for access.<ref>Cornell University Law School, [http://www4.law.cornell.edu/uscode/html/uscode17/usc_sec_17_00001201----000-.html US Code: Title 17,1201. Circumvention of copyright protection systems.] Retrieved August 12, 2008.</ref> Aside from restrictions on circumvention, reverse engineering of software is protected in the U.S. by the [[fair use]] exception in [[copyright|copyright law]].<ref>Pamela Samuelson and Suzanne Scotchmer, The Law and Economics of Reverse Engineering, 111, ''Yale Law Journal'' 1575-1663.</ref> The [[Samba software]], which allows systems that are not running [[Microsoft Windows]] systems to share files with systems that are, is a classic example of software reverse engineering, since the Samba project had to reverse-engineer unpublished information about how Windows file sharing worked, so that non-Windows computers could emulate it. The [[Wine (software)|Wine]] project does the same thing for the [[Windows API]], and [[OpenOffice.org]] is one party doing this for the [[Microsoft Office]] file formats. The [[ReactOS]] project is even more ambitious in its goals as it strives to provide binary (ABI and API) compatibility with the current Windows OSes of the NT branch, allowing software and drivers written for Windows to run on a clean room reverse engineered GPL open source counterpart.
  
 
====Binary software techniques====
 
====Binary software techniques====
Line 39: Line 37:
  
 
==Source code==
 
==Source code==
A number of [[Unified Modeling Language|UML]] tools refer to the process of importing source code in order to generate UML diagrams, as "reverse engineering." See [[List of UML tools]].
+
A number of [[Unified Modeling Language|UML]] tools refer to the process of importing source code in order to generate UML diagrams, as "reverse engineering."  
  
 
==Reverse-engineering of integrated circuits/smart cards==
 
==Reverse-engineering of integrated circuits/smart cards==
Reverse Engineering is an invasive and destructive form of analyzing a smart card. The attacker grinds away layer by layer of the smart card and takes pictures with an electron-microscope. With this technique it is possible to reveal the complete hardware and software part of the smart card. The major problem for the attacker is to bring everything into the right order to find out how everything works. Engineers try to hide keys and operations by mixing up memory positions, for example [[busscrambling]]<ref>Wolfgang Rankl, Wolfgang Effing, Smart Card Handbook (2004)</ref><ref>T. Welz: Smart cards as methods for payment (2008), Seminar ITS-Security Ruhr-Universität Bochum, "http://www.crypto.rub.de/its_seminar_ws0708.html"</ref>.
+
Reverse Engineering is an invasive and destructive form of analyzing a smart card. The attacker grinds away layer by layer of the smart card and takes pictures with an electron-microscope. With this technique it is possible to reveal the complete hardware and software part of the smart card. The major problem for the attacker is to bring everything into the right order to find out how everything works. Engineers try to hide keys and operations by mixing up memory positions, for example [[busscrambling]]<ref>Wolfgang Rankl and Wolfgang Effing, ''Smart Card Handbook'' (New York: Wiley, 1999, ISBN 9780471967200).</ref>
In some cases it is even possible to attach a probe to direct measure voltages while the smart card is still operational. Engineers employ sensors to detect and prevent this attack. <ref>David C. Musker: Protecting & Exploiting Intellectual Property in Electronics, IBC Conferences, 10 June 1998</ref> It takes very high effort to break a smart card used for payment e.g., and the technical equipment is only available to large chip-producers. Additionally the gain is low due to other security mechanisms like shadow accounts.
+
 
 +
In some cases it is even possible to attach a probe to direct measure voltages while the smart card is still operational. Engineers employ sensors to detect and prevent this attack.<ref>David C. Musker, Protecting & Exploiting Intellectual Property in Electronics, ''IBC Conferences'' (1998).</ref> It takes very high effort to break a smart card used for payment, for example, and the technical equipment is only available to large chip-producers. Additionally the gain is low due to other security mechanisms like shadow accounts.
  
 
==Reverse-engineering for military applications==
 
==Reverse-engineering for military applications==
Reverse engineering is often used by [[military]] in order to copy other nations' [[technology]], devices or information, or parts of which, have been obtained by regular troops in the fields or by [[military intelligence|intelligence]] operations. It was often used during the [[Second World War]] and the [[Cold War]]. Well-known examples from WWII and later include:
+
Reverse engineering is often used by [[military]] in order to copy other nations' [[technology]], devices or information, or parts of which, have been obtained by regular troops in the fields or by [[military intelligence|intelligence]] operations. It was often used during the Second World War and the [[Cold War]]. Well-known examples from [[World War II]] and later include:
  
* [[Jerry can]]: British and American forces noticed that the Germans had gasoline cans with an excellent design. They reverse engineered copies of those cans. The cans were popularly known as ''Jerry cans''.
+
* [[Jerry can]]: British and American forces noticed that the Germans had gasoline cans with an excellent design. They reverse engineered copies of those cans. The cans were popularly known as "Jerry cans."
 
* [[Tupolev Tu-4]]: Three American [[B-29 Superfortress|B-29]] bombers on missions over [[Japan]] were forced to land in the [[Soviet Union|USSR]]. The Soviets, who did not have a similar strategic bomber, decided to copy the B-29. Within a few years they had developed the Tu-4, a near perfect copy.
 
* [[Tupolev Tu-4]]: Three American [[B-29 Superfortress|B-29]] bombers on missions over [[Japan]] were forced to land in the [[Soviet Union|USSR]]. The Soviets, who did not have a similar strategic bomber, decided to copy the B-29. Within a few years they had developed the Tu-4, a near perfect copy.
* [[V2 Rocket]]: Technical documents for the V2 and related technologies were captured by the Western Allies at the end of the war. Soviet and captured German engineers had to reproduce technical documents and plans, working from captured hardware, in order to make their clone of the rocket, the [[R-1 (missile)|R-1]], which began the postwar Soviet rocket program that led to the [[R-7 Semyorka|R-7]] and the beginning of the [[space race]].
+
* [[V2 Rocket]]: Technical documents for the V2 and related technologies were captured by the Western Allies at the end of the war. Soviet and captured German engineers had to reproduce technical documents and plans, working from captured hardware, in order to make their clone of the rocket, the [[R-1 (missile)|R-1]], which began the postwar Soviet rocket program that led to the [[R-7 Semyorka|R-7]] and the beginning of the [[space race]].
* [[Vympel K-13|K-13/R-3S]] missile ([[NATO reporting name]] '''AA-2 'Atoll'''), a Soviet [[reverse-engineered]] copy of the [[AIM-9 Sidewinder]], made possible after a Taiwanese AIM-9B hit a Chinese [[MiG-17]] without exploding; amazingly, the missile became lodged within the airframe, the pilot returning to base with what Russian scientists would describe as a university course in missile development.
+
* [[Vympel K-13|K-13/R-3S]] missile ([[NATO reporting name]] '''AA-2 Atoll'''), a Soviet [[reverse-engineered]] copy of the [[AIM-9 Sidewinder]], made possible after a Taiwanese AIM-9B hit a Chinese [[MiG-17]] without exploding; amazingly, the missile became lodged within the airframe, the pilot returning to base with what Russian scientists would describe as a university course in missile development.
* [[BGM-71_TOW]] Missile: In May 1975 negotiations between Iran and Hughes Missile Systems on co-production of the TOW and Maverick missiles are stalled over disagreements in the pricing structure. The subsequent [[1979 revolution]] ended all plans for such co-production. Iran was successful in reverse engineering the missile, and are currently producing their own copy: the [[Toophan]].
+
* [[BGM-71_TOW]] Missile: In May 1975, negotiations between Iran and Hughes Missile Systems on co-production of the TOW and Maverick missiles stalled over disagreements in the pricing structure. The subsequent [[1979 revolution]] ended all plans for such co-production. Iran was successful in reverse engineering the missile, and are currently producing their own copy: The [[Toophan]].
  
 
==Legality==
 
==Legality==
Line 59: Line 58:
 
Reverse engineering software or hardware systems which is done for the purposes of [[interoperability]] (for example, to support undocumented file formats or undocumented hardware peripherals), is mostly believed to be legal, though patent owners often contest this and attempt to stifle any reverse engineering of their products for any reason.
 
Reverse engineering software or hardware systems which is done for the purposes of [[interoperability]] (for example, to support undocumented file formats or undocumented hardware peripherals), is mostly believed to be legal, though patent owners often contest this and attempt to stifle any reverse engineering of their products for any reason.
  
"...[W]here disassembly is the only way to gain access to the ideas and functional elements embodied in a copyrighted computer program and where there is a legitimate reason for seeking such access, disassembly is a fair use of the copyrighted work, as a matter of law."<ref>Sega v. Accolade, 203 F.3d 596 (9th Cir. 1993)</ref>
+
"[W]here disassembly is the only way to gain access to the ideas and functional elements embodied in a copyrighted computer program and where there is a legitimate reason for seeking such access, disassembly is a fair use of the copyrighted work, as a matter of law."<ref>Sega v. Accolade, 203 F.3d 596 (9th Cir. 1993).</ref>
  
 
==See also==
 
==See also==
 
 
* [[Antikythera mechanism]]
 
* [[Antikythera mechanism]]
 
* [[Benchmarking]]
 
* [[Benchmarking]]
Line 82: Line 80:
  
 
== References ==
 
== References ==
 +
* Chuvakin, Anton and Cyrus Peikari. 2004. ''Security Warrior''. Sebastopol, CA: O'Reilly & Associates, Inc. ISBN 9780596005450.
 +
* Eilam, Eldad. 2005. ''Reversing: Secrets of Reverse Engineering.'' Indianapolis: Wiley. ISBN 9780764574818.
 +
* Warden, R. 1992. ''Software Reuse and Reverse Engineering in Practice.'' London: Chapman & Hall. ISBN 9780442314095.
  
* Eilam, Eldad. 2005. ''Reversing: Secrets of Reverse Engineering.'' Indianapolis, IN: Wiley. ISBN 9780764574818.
+
==External links==
 +
All links retrieved December 8, 2022.
  
==External links==
+
* Várady, Tamás. [http://www.ercim.org/publication/Ercim_News/enw44/varady.html Reverse Engineering Shapes.]  
* [http://www.reverse-engineering.net/ Reverse Code Engineering], as entry point for Reverse Code Engineering
+
* [http://www.cs.cmu.edu/~aldrich/courses/654-sp05/ReengineeringTaxonomy.pdf Chikofsky, E.J.; J.H. Cross II (January 1990). "Reverse Engineering and Design Recovery: A Taxonomy in IEEE Software." IEEE Computer Society: 13–17.] - Original Paper hosted at cs.cmu.edu.
* [http://www.iitac.org IITAC.org: Reverse Code Engineering certification] according to [[ISO|ISO 17024]]
 
* [http://www.crackmes.de Crackmes.de The longest running and most complete Crackmes web page on the internet. Free Reverse Code Engineering training material]
 
* [http://www.woodmann.com Reverse Code Engineering: The complete resource for RE of software. Archives of the most important Reverse Code Engineering sites]
 
* [http://www.openrce.org OpenRCE: Reverse Engineering Portal]
 
* [http://www.eclipse.org/gmt/modisco/ MoDisco: (Model Discovery), an Eclipse Project on Model Driven Reverse Engineering]
 
* [http://www.eresi-project.org ERESI: The ERESI Reverse Engineering Software Interface] for RCE on UNIX
 
* [http://radare.nopcode.org Radare: Advanced CmdLine Hexadecimal Editor, Disassembler and Debugger] multi-platform full-featured RCE tool
 
* [http://www.program-transformation.org/Transform/ReverseEngineering Program transformation wiki on Reverse Engineering]
 
* [http://www.acm.uiuc.edu/sigmil/RevEng/ Introduction to Reverse Engineering Software], preprint of a book by [[Mike Perry]] and [[Nasko Oskov]].
 
* [http://www.ercim.org/publication/Ercim_News/enw44/varady.html Reverse Engineering Shapes], article by [[Tamás Várady]]
 
* [http://www.reteam.org/ Online Resource for Reverse Engineering Software]
 
* [http://www.jenkins-ip.com/serv/serv_6.htm Article on legal considerations] by [[David C. Musker]]
 
* [http://archives.cnn.com/2001/US/01/25/smithsonian.cold.war/ CNN: How Soviets copied America's best bomber during WWII]
 
* [http://w3.umh.ac.be/genlog/SE/SE-contents.html#ReverseEngineering Very good RE definitions from Software Engineering]
 
* [http://adm.omg.org Architecture-Driven Modernization group at OMG]
 
* [http://www.elecdesign.com/Articles/Index.cfm?ArticleID=11966 Reverse Engineering Delivers Product Knowledge Aids Technology Spread] - Article in Electronic Design by Dick James, Senior Technology Adviser, Chipworks
 
* [http://www.cs.cmu.edu/~aldrich/courses/654-sp05/ReengineeringTaxonomy.pdf Chikofsky, E.J.; J.H. Cross II (January 1990). "Reverse Engineering and Design Recovery: A Taxonomy in IEEE Software." IEEE Computer Society: 13–17.] - Original Paper hosted at cs.cmu.edu
 
  
 
[[Category:Physical sciences]]
 
[[Category:Physical sciences]]
 
[[Category:Engineering]]
 
[[Category:Engineering]]
[[Category:Computer technology]]
 
  
 
{{credit|229008702}}
 
{{credit|229008702}}

Latest revision as of 19:59, 8 December 2022

Reverse engineering (RE) is the process of discovering the technological principles of a device, object or system through analysis of its structure, function, and operation. It often involves taking something (for example a mechanical device, electronic component, or software program) apart and analyzing its workings in detail, usually to try to make a new device or program that does the same thing without copying anything from the original.

Motivation

Reasons for reverse-engineering:

  • Interoperability
  • Lost documentation: Reverse engineering often is done because the documentation of a particular device has been lost (or was never written), and the person who built it is no longer available. Integrated circuits often seem to have been designed on obsolete, proprietary systems, which means that the only way to incorporate the functionality into new technology is to reverse-engineer the existing chip and then re-design it.
  • Product analysis. To examine how a product works, what components it consists of, estimate costs, identify potential patent infringement.
  • Security auditing
  • Removal of copy protection, circumvention of access restrictions.
  • Creation of unlicensed/unapproved duplicates
  • Fraud

Reverse engineering of mechanical devices

As computer-aided design has become more popular, reverse engineering has become a viable method to create a 3D virtual model of an existing physical part for use in 3D CAD, CAM, CAE and other software.[1] The reverse engineering process involves measuring an object and then reconstructing it as a 3D model. The physical object can be measured using 3D scanning technologies like CMMs, laser scanners, structured light digitizers, or computed tomography. The measured data alone, usually represented as a point cloud, lacks topological information and is therefore often processed and modeled into a more usable format such as a triangular faced mesh, a set of NURBS surfaces or a CAD model. Applications like Imageware, PolyWorks, Rapidform, or Geomagic are used to process the point clouds themselves into formats usable in other applications such as 3D CAD, CAM, CAE or visualization.

Reverse engineering is also used by businesses to bring existing physical geometry into digital product development environments, to make a digital 3D record of their own products or assess competitors' products. It is used to analyze, for instance, how a product works, what it does, what components it consists of, estimate costs, identify potential patent infringement, etc.

Value engineering is a related activity also used by business. It involves deconstructing and analyzing products, but the objective is to find opportunities for cost cutting.

Reverse engineering of software

The term "reverse engineering" as applied to software means different things to different people, prompting Chikofsky and Cross to write a paper researching the various uses and defining a taxonomy. According to them, Reverse engineering is the process of analyzing a subject system to create representations of the system at a higher level of abstraction.[2] It can also be seen as "going backwards through the development cycle".[3] In this model, the output of the implementation phase (in source code form) is reverse engineered back to the analysis phase, in an inversion of the traditional waterfall model. Reverse engineering is a process of examination only: the software system under consideration is not modified (which would make it reengineering). Software anti-tamper technology is used to deter both reverse engineering and reengineering of proprietary software and software-powered systems. In practice, two main types of reverse engineering emerge. In the first case, source code is already available for the software, but higher level aspects of the program, perhaps poorly documented or documented but no longer valid, are discovered. In the second case, there is no source code available for the software, and any efforts towards discovering one possible source code for the software are regarded as reverse engineering. This second usage of the term is the one most people are familiar with. Reverse engineering of software can make use of the clean room design technique to avoid infringing copyrights.

On a related note, black box testing in software engineering has a lot in common with reverse-engineering. The tester usually has the API, but their goals are to find bugs and undocumented features by bashing the product from outside.

Other purposes of reverse engineering include security auditing, removal of copy protection ("cracking"), circumvention of access restrictions often present in consumer electronics, customization of embedded systems (such as engine management systems), in-house repairs or retrofits, enabling of additional features on low-cost "crippled" hardware (such as some graphics card chipsets), or even mere satisfaction of curiosity.

Binary software

This process is sometimes termed Reverse Code Engineering or RCE.[4] As an example, decompilation of binaries for the Java platform can be accomplished using Jad. One famous case of reverse engineering was the first non-IBM implementation of the PC BIOS which launched the historic IBM PC compatible industry that has been the overwhelmingly dominant computer hardware platform for many years. An example of a group that reverse engineers software for enjoyment is CORE, which stands for "Challenge Of Reverse Engineering." In the United States, the Digital Millennium Copyright Act exempts from the circumvention ban some acts of reverse engineering aimed at interoperability of file formats and protocols, but judges in key cases have ignored this law, since it is acceptable to circumvent restrictions for use, but not for access.[5] Aside from restrictions on circumvention, reverse engineering of software is protected in the U.S. by the fair use exception in copyright law.[6] The Samba software, which allows systems that are not running Microsoft Windows systems to share files with systems that are, is a classic example of software reverse engineering, since the Samba project had to reverse-engineer unpublished information about how Windows file sharing worked, so that non-Windows computers could emulate it. The Wine project does the same thing for the Windows API, and OpenOffice.org is one party doing this for the Microsoft Office file formats. The ReactOS project is even more ambitious in its goals as it strives to provide binary (ABI and API) compatibility with the current Windows OSes of the NT branch, allowing software and drivers written for Windows to run on a clean room reverse engineered GPL open source counterpart.

Binary software techniques

Reverse engineering of software can be accomplished by various methods. The three main groups of software reverse engineering are

  1. Analysis through observation of information exchange, most prevalent in protocol reverse engineering, which involves using bus analyzers and packet sniffers, for example, for accessing a computer bus or computer network connection and revealing the traffic data thereon. Bus or network behavior can then be analyzed to produce a stand-alone implementation that mimics that behavior. This is especially useful for reverse engineering device drivers. Sometimes reverse-engineering on embedded systems is greatly assisted by tools deliberately introduced by the manufacturer, such as JTAG ports or other debugging means. In Microsoft Windows, low-level debuggers such as SoftICE are popular.
  2. Disassembly using a disassembler, meaning the raw machine language of the program is read and understood in its own terms, only with the aid of machine language mnemonics. This works on any computer program but can take quite some time, especially for someone not used to machine code. The Interactive Disassembler is a particularly popular tool.
  3. Decompilation using a decompiler, a process that tries, with varying results, to recreate the source code in some high level language for a program only available in machine code or bytecode.

Source code

A number of UML tools refer to the process of importing source code in order to generate UML diagrams, as "reverse engineering."

Reverse-engineering of integrated circuits/smart cards

Reverse Engineering is an invasive and destructive form of analyzing a smart card. The attacker grinds away layer by layer of the smart card and takes pictures with an electron-microscope. With this technique it is possible to reveal the complete hardware and software part of the smart card. The major problem for the attacker is to bring everything into the right order to find out how everything works. Engineers try to hide keys and operations by mixing up memory positions, for example busscrambling[7]

In some cases it is even possible to attach a probe to direct measure voltages while the smart card is still operational. Engineers employ sensors to detect and prevent this attack.[8] It takes very high effort to break a smart card used for payment, for example, and the technical equipment is only available to large chip-producers. Additionally the gain is low due to other security mechanisms like shadow accounts.

Reverse-engineering for military applications

Reverse engineering is often used by military in order to copy other nations' technology, devices or information, or parts of which, have been obtained by regular troops in the fields or by intelligence operations. It was often used during the Second World War and the Cold War. Well-known examples from World War II and later include:

  • Jerry can: British and American forces noticed that the Germans had gasoline cans with an excellent design. They reverse engineered copies of those cans. The cans were popularly known as "Jerry cans."
  • Tupolev Tu-4: Three American B-29 bombers on missions over Japan were forced to land in the USSR. The Soviets, who did not have a similar strategic bomber, decided to copy the B-29. Within a few years they had developed the Tu-4, a near perfect copy.
  • V2 Rocket: Technical documents for the V2 and related technologies were captured by the Western Allies at the end of the war. Soviet and captured German engineers had to reproduce technical documents and plans, working from captured hardware, in order to make their clone of the rocket, the R-1, which began the postwar Soviet rocket program that led to the R-7 and the beginning of the space race.
  • K-13/R-3S missile (NATO reporting name AA-2 Atoll), a Soviet reverse-engineered copy of the AIM-9 Sidewinder, made possible after a Taiwanese AIM-9B hit a Chinese MiG-17 without exploding; amazingly, the missile became lodged within the airframe, the pilot returning to base with what Russian scientists would describe as a university course in missile development.
  • BGM-71_TOW Missile: In May 1975, negotiations between Iran and Hughes Missile Systems on co-production of the TOW and Maverick missiles stalled over disagreements in the pricing structure. The subsequent 1979 revolution ended all plans for such co-production. Iran was successful in reverse engineering the missile, and are currently producing their own copy: The Toophan.

Legality

In the United States and many other countries, even if an artifact or process is protected by trade secrets, reverse-engineering the artifact or process is often lawful as long as it is obtained legitimately. Patents, on the other hand, need a public disclosure of an invention, and therefore patented items do not necessarily have to be reverse engineered to be studied. One common motivation of reverse engineers is to determine whether a competitor's product contains patent infringements or copyright infringements.

Reverse engineering software or hardware systems which is done for the purposes of interoperability (for example, to support undocumented file formats or undocumented hardware peripherals), is mostly believed to be legal, though patent owners often contest this and attempt to stifle any reverse engineering of their products for any reason.

"…[W]here disassembly is the only way to gain access to the ideas and functional elements embodied in a copyrighted computer program and where there is a legitimate reason for seeking such access, disassembly is a fair use of the copyrighted work, as a matter of law."[9]

See also

  • Antikythera mechanism
  • Benchmarking
  • Bus analyzer
  • Chinese copy method
  • Clean room design
  • Code morphing
  • Decompiler
  • Digital Millennium Copyright Act
  • Forensic engineering
  • Interactive Disassembler
  • J. Brant Arseneau
  • Knowledge Discovery Metamodel
  • Logic analyzer
  • Value engineering

Notes

  1. T. Varady, R.R. Martin, and J. Cox, Reverse Engineering of Geometric Models—An Introduction, Computer Aided Design 29(4): 255-268.
  2. E.J. Chikofsky and J.H. Cross II, Reverse Engineering and Design Recovery: A Taxonomy in IEEE Software, IEEE Computer Society 13–17.
  3. R. Warden, Software Reuse and Reverse Engineering in Practice (London: Chapman & Hall, 1992, ISBN 9780442314095).
  4. Anton Chuvakin and Cyrus Peikari, Security Warrior (Sebastopol, CA: O'Reilly & Associates, Inc., 2004, ISBN 9780596005450).
  5. Cornell University Law School, US Code: Title 17,1201. Circumvention of copyright protection systems. Retrieved August 12, 2008.
  6. Pamela Samuelson and Suzanne Scotchmer, The Law and Economics of Reverse Engineering, 111, Yale Law Journal 1575-1663.
  7. Wolfgang Rankl and Wolfgang Effing, Smart Card Handbook (New York: Wiley, 1999, ISBN 9780471967200).
  8. David C. Musker, Protecting & Exploiting Intellectual Property in Electronics, IBC Conferences (1998).
  9. Sega v. Accolade, 203 F.3d 596 (9th Cir. 1993).

References
ISBN links support NWE through referral fees

  • Chuvakin, Anton and Cyrus Peikari. 2004. Security Warrior. Sebastopol, CA: O'Reilly & Associates, Inc. ISBN 9780596005450.
  • Eilam, Eldad. 2005. Reversing: Secrets of Reverse Engineering. Indianapolis: Wiley. ISBN 9780764574818.
  • Warden, R. 1992. Software Reuse and Reverse Engineering in Practice. London: Chapman & Hall. ISBN 9780442314095.

External links

All links retrieved December 8, 2022.

Credits

New World Encyclopedia writers and editors rewrote and completed the Wikipedia article in accordance with New World Encyclopedia standards. This article abides by terms of the Creative Commons CC-by-sa 3.0 License (CC-by-sa), which may be used and disseminated with proper attribution. Credit is due under the terms of this license that can reference both the New World Encyclopedia contributors and the selfless volunteer contributors of the Wikimedia Foundation. To cite this article click here for a list of acceptable citing formats.The history of earlier contributions by wikipedians is accessible to researchers here:

The history of this article since it was imported to New World Encyclopedia:

Note: Some restrictions may apply to use of individual images which are separately licensed.