Serializing data into a C++17 std::byte vector

Question

I'm trying to serialize/deserialize data to/from std::vector<std::byte>. The code below shows one solution with boost::serialization, but I think this applies to other serialization libraries. The problem with the solution is that it uses use std::ostringstream and std::string. I would like to avoid those and avoid the std::memcpy asociated with them. Is there an elegant way to serialize the data directly into a std::vector<std::byte>?

std::vector<std::byte> serialize(const T& data) {
    std::ostringstream data_archive_stream;
    {
        boost::archive::binary_oarchive data_archive{data_archive_stream};
        data_archive << data;
    }
    std::string str = data_archive_stream.str();
    std::vector<std::byte> serialized{str.length()};
    std::memcpy(serialized.data(), str.data(), str.length());
    return serialized;
}