{"id":3793,"date":"2018-03-19T10:56:18","date_gmt":"2018-03-19T17:56:18","guid":{"rendered":"https:\/\/visualgdb.com\/w\/?p=3793"},"modified":"2018-03-19T10:56:18","modified_gmt":"2018-03-19T17:56:18","slug":"diagnosing-debugging-symbol-load-errors-for-linux-applications","status":"publish","type":"post","link":"https:\/\/visualgdb.com\/tutorials\/linux\/symbols\/","title":{"rendered":"Diagnosing Debugging Symbol Load Errors for Linux Applications"},"content":{"rendered":"

This tutorial shows how to diagnose common problems with debugging symbols\u00a0for Linux C\/C++ applications. We will create a basic application with VisualGDB, break the debug symbol generation to illustrate common project setup problems and will then show how to\u00a0check the ELF files for debug symbols and restore the settings required for\u00a0generating the debug information.<\/p>\n

Before you begin, install Visual Studio and VisualGDB.<\/p>\n

    \n
  1. Start Visual Studio and open the VisualGDB Linux Project wizard:\"01-newprj\"<\/a><\/li>\n
  2. Proceed with creating an MSBuild-based application:\"02-msb\"<\/a><\/li>\n
  3. Select the Linux machine you would like to use for building the\u00a0code:\"03-target\"<\/a><\/li>\n
  4. Proceed with the default source code access settings:\"04-store\"<\/a>Then press “Finish” to create the project.<\/li>\n
  5. In order to successfully debug\u00a0your project, the final ELF file needs to have debug symbols – information relating addresses in your program to specific source lines and variable names. This information is generated when you pass “-ggdb” to the gcc arguments when compiling each source file and and might be removed\u00a0from the final executable by either specifying “-s” in the linker flags or using the “strip” tool after the linking:\"scheme\"<\/a><\/li>\n
  6. We will now\u00a0show what happens if the debug information is removed\u00a0from the executable and how to\u00a0track back the\u00a0option responsible for removing it. Open\u00a0VS Project Properties and clear the “Debug Information Format” setting under C\/C++->General:\"05-nodebug1\"<\/a><\/li>\n
  7. Go to the Linker Settings and add “-s” to linker command line:\"06-strip\"<\/a><\/li>\n
  8. Set a breakpoint in main() and try debugging the program. VisualGDB will\u00a0warn that the program exits without triggering a single breakpoint. The GDB Session log will contain the following line:\n
    No symbol table is loaded. Use the \"file\" command.<\/pre>\n
    \"07-symtable\"<\/a><\/li>\n
  9. This message means that\u00a0the program debugged by gdb is missing the debug symbols. The first step of diagnosing it would be to locate the binary on the build machine and run the following command on it:\n
    objdump -h <ELF file> | grep debug<\/pre>\n<\/li>\n
  10. If the output is empty, locate some of the .o files corresponding to your source files and run the same command on them:
    \n    \"08-nodebug\"<\/a>In this example the output is empty for both the final ELF file and the .o file (since we have disabled\u00a0debug information generation\u00a0via C\/C++ compiler settings).<\/li>\n
  11. You can also open the file in gdb and run the “info sources” command (same will work for the .o file) to double-check this.\u00a0GDB will respond that no symbols are present:\"09-sources\"<\/a><\/li>\n
  12. Since the .o files don’t have the symbols either,\u00a0we narrowed down the problem to the missing -ggdb flag. For MSBuild projects the flags are stored in the .gcc.rsp files,\u00a0however if your project is built via custom Makefiles,\u00a0you might need to enable verbose build mode (e.g. V=1, _V=1 or VERBOSE=1) to see the full command line:
    \n    \"10-rsp\"<\/a><\/li>\n
  13. Go to VS Project Properties and restore the Debug Information Format setting:\"11-optigdb\"<\/a><\/li>\n
  14. Build the project and re-run the objdump commands. See how the .o file now contains .debug_xxx sections storing the debug symbols:\"12-symbols\"<\/a><\/li>\n
  15. The final ELF file is still not debuggable as we did not remove the “-s” option from the\u00a0linker settings. Running objdump on it will confirm this:
    \n    \"13-nofinal\"<\/a><\/li>\n
  16. If you\u00a0observe this with your projects (debug\u00a0information in the .o files, but not in the final ELF file), check that the linker command line doesn’t contain the “-s” switch. Once you remove it from the project properties, the debug information will get propagated to the final ELF file:\"14-final\"<\/a>If the command lines look correct, but the symbols are still not propagated (or generated), try copying the command line from the logs, removing the .o (or ELF) file, running gcc manually and recheck the generated file.\u00a0 You may find out that the custom Makefiles you are using are not displaying all build\u00a0flags correctly or they do a some custom\u00a0post-build step that removes the debug information.<\/li>\n
  17. You can also explore the debug information by running “objdump -g <ELF file> | less”:\"15-unit\"<\/a>Scroll to the contents of the .debug_info<\/strong> section and check for\u00a0the\u00a0“Compilation Unit” records.\u00a0Each source file compiled with debug\u00a0symbols will have a corresponding record listed in the final ELF file.<\/li>\n
  18. Another reason why the debug information could be missing is the ‘strip’ tool. It dramatically reduces the size of the ELF binaries by removing debug information from them (also breaking source-level debugging). You can try running it on your executable and compare the sizes before and after it (also confirming that the .debug_xxx<\/strong> sections disappear):
    \n    \"16-strip\"<\/a>If running the link command line manually produces an executable with valid symbols, but the final executable built by your Make scripts doesn’t have them, most likely\u00a0the Make scripts run the ‘strip’ tool to reduce the binary size. In this case disabling this command for debug builds should get debugging\u00a0to work.<\/li>\n<\/ol>\n","protected":false},"excerpt":{"rendered":"
    This tutorial shows how to diagnose common problems with debugging symbols\u00a0for Linux C\/C++ applications. We will create a basic application<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[10],"tags":[75,33],"_links":{"self":[{"href":"https:\/\/visualgdb.com\/w\/wp-json\/wp\/v2\/posts\/3793"}],"collection":[{"href":"https:\/\/visualgdb.com\/w\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/visualgdb.com\/w\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/visualgdb.com\/w\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/visualgdb.com\/w\/wp-json\/wp\/v2\/comments?post=3793"}],"version-history":[{"count":1,"href":"https:\/\/visualgdb.com\/w\/wp-json\/wp\/v2\/posts\/3793\/revisions"}],"predecessor-version":[{"id":3811,"href":"https:\/\/visualgdb.com\/w\/wp-json\/wp\/v2\/posts\/3793\/revisions\/3811"}],"wp:attachment":[{"href":"https:\/\/visualgdb.com\/w\/wp-json\/wp\/v2\/media?parent=3793"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/visualgdb.com\/w\/wp-json\/wp\/v2\/categories?post=3793"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/visualgdb.com\/w\/wp-json\/wp\/v2\/tags?post=3793"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}