Correct, unless a passage states that it is a 'parable,' for example, or some other intended application. Do you see a problem with reading the entire Bible in such a light?

There is nothing in Genesis that indicates it is not to be read literally. In fact, the evidence is quite the contrary. The evidence indicates that the prophets, apostles and Christ read Genesis literally.

In preparing for a debate with a young-earth creationist, he [Stephen J. Godfrey, paleontologist and co-author of the book] decided—after several years of avoiding the Genesis creation account because of painful experiences associated with it—to reacquaint himself with it by reading it through many times. In so doing, he made a startling discovery. He realized to that point he had not been able to make sense of what was written because he had automatically but subconsciously been interpreting the text based on a 21st-century cosmological understanding. His reading was suffering from the proverbial "paradigm effect."

Therefore, in rereading the creation account, he made a conscious effort to forget what he knew about the structure of our solar system and the universe beyond.... The result of this experience was a radical new approach for what this account actually says.