Out-of-memory problem caused Mars rover's glitch
The rover systems are again working on the Martian surface
Computerworld - A shortage of memory on board the Spirit Mars rover is what caused it to become unresponsive on the Martian surface on Jan. 22, raising fears that the Martian mission might end almost before it began in earnest.
Mike Deliman, a technical staff member at Wind River Systems Inc., which provided the real-time embedded operating system used in the mission, said the problem has been re-created in testing on Earth and appears to be entirely memory-related.
"It's not a software bug, it's not an application bug, and it's not a hardware bug," Deliman said. "It's a system constraint that we ran up against."
The Spirit rover dedicates 32MB of its 128MB of RAM to the onboard Wind River VxWorks operating system and a host of science applications, and as the mission progresses, technicians are scheduled to periodically delete old files and directories to clear out the memory for reuse, he said.
But with all the excitement after the Mars landing on Jan. 3, and with data being returned to Earth by the rover, that step was not performed quickly enough by mission technicians.
"We just ran out of memory, ran out of RAM," Deliman said. "This is why we initially lost contact" with the rover. The six-wheeled vehicle runs hundreds of tasks simultaneously in normal operations, with each operation using its own chunk of RAM, he said.
The VxWorks operating system was embedded in a specially prepared, radiation-hardened 20-MHz PowerPC CPU installed on each of the rovers, along with 128MB of RAM (see story). The hardware was cutting-edge back when it was chosen in the mid-1990s, but then it had to be treated to ensure its reliability in the radiation of deep space -- a process that takes five to 10 years.
"It's like having an old Windows machine that has a very little bit of disk space [remaining]," Deliman said. "When you run up against the end of your disk, if you don't clean it up, your system becomes unstable."
For about a week, scientists worked to figure out why the rover wasn't responding to commands from Earth and feared that a hardware problem could halt the rover in its tracks.
Technicians were eventually able to correct the problem when the rover went into a diagnostic mode, Deliman said. Diagnostic commands were beamed up to the machine, and a series of files and folders were deleted from a flash-memory-based file system board, allowing the rover to resume normal operations.
The Spirit rover is now continuing to take photographs on the Martian surface and conducting experiments for NASA. A second Mars rover, Opportunity, landed on Jan. 24 and has also been operating on the surface of the red planet. A minor glitch with a heater that won't shut off on Opportunity's robotic arm is the only problem experienced by that machine so far.
This pilot fish is a contractor at a military base, working on some very cool fire-control systems for tanks. But when he spots something obviously wrong during a live-fire test, he can't get the firing-range commander's attention.
- IT Certification Study Tips
- Register for this Computerworld Insider Study Tip guide and gain access to hundreds of premium content articles, cheat sheets, product reviews and more.
- Reduce federal infrastructure risk with compliance management and situational awareness
- IBM continuous monitoring and management solutions deliver real-time situational awareness to help federal agencies understand vulnerabilities, and protect the infrastructure.
- Comprehensive Advanced Threat Defense
- The hot topic in the information security industry these days is "Advanced Threat Defense" (ATD). This paper describes a comprehensive, network-based approach to...
- Advanced Threat Defense: A Comprehensive Approach
- In this interview, Peter George, president, General Dynamics Fidelis Cybersecurity Solutions, explains why we need more than anti-malware, and what constitutes a comprehensive...
- Market Overview: Digital Customer Experience Delivery Platforms
- Forrester states that businesses today struggle to understand and use the tools necessary to create and manage unified, multichannel digital customer experiences across...
- The Growing Demand for Rich Media
- This white paper discusses how IBM Customer Experience Suite Rich Media Edition can automate rich media workflows, from collaborating with creative agencies and... All Government IT White Papers
- It's not too late...Get Your Mobile Questions Answered Live! How can IT provide seamless and secure mobile communications and collaboration for all? Join this live Webcast as IDG asks an expert panel...
- On-demand webinar - 7 Keys to Service Catalog Implementation Success Watch this webinar to learn 7 crucial keys to make your service catalog a success!
- Transform Your IT Service Management Watch this webinar, to learn how EasyVista can increase IT productivity & efficiency and deliver streamlined & integrated IT Service & Asset Mgmt.
- IBM FlashSystem V840: Leveraging Software-Defined Flash to Drive Your Business With end-to-end, tightly integrated functionality and super-fast flash technology, products like IBM FlashSystem V840 Enterprise Performance Solution empower businesses to leverage the efficiency...
- Leveraging Flash Storage to Accelerate Oracle Real Application Clusters Join this webinar to understand the latest solid-state storage trends, the specific applications driving solid-state storage deployments and the benefits of deploying the...
- All Government IT Webcasts