An Alexandria office building near the banks of the Potomac River that recently sold for $21 million will be turned into condos.