Woman used to be wifman, a combination of wif, meaning "woman" (whence wife), and man in the meaning "human being". Female, on the other hand, comes from Latin femella (compare feminine) and is not related to male which comes from Latin masculus (whence masculine, macho). In other words, no, wo- is not a productive prefix in contemporary English, and fe- was never a prefix to begin with.