Persistent Ignorant Domain with Entity Framework and Spacial Data

I'm developing an application that implements DDD and Repository Pattern as shown in diagram bellow:

I expect to keep my Domain Layer persistent ignorant, so I wouldn't like to install entity framework libraries there. The only problem I'm facing is that my application uses spatial data, but I'm not supposed to use DbGeography as a Property Type of my entities, once it belongs to System.Data.Entity.Spatial namespace, from EntityFramework assembly.

Is there a way to create a class to hold latitude, longitude and elevation values in Domain Layer, like that:

public class Location
{
    public double Latitude { get; set; }
    public double Longitude { get; set; }
    public double Elevation { get; set; }
}

and then convert that class to DbGeography in my Repository Layer?

In other words, the domain entities would have only Location class as a property:

public class Place : IEntityBase, ILocalizable
{
    public int Id { get; set; }
    public string Name { get; set; }
    public Location Location { get; set; }
    public User Owner { get; set; }
}

and I'd convert it DbGegraphy to persist spatial data and do some calculations only in repository layer. My plans was try something like that to convert:

public class LocationMap : ComplexTypeConfiguration<Location>
{
    public LocationMap()
    {
        Property(l => DbGeography.FromText(string.Format("POINT({0} {1})", l.Longitude, l.Latitude))).HasColumnName("Location");
        Ignore(l => l.Elevation);
        Ignore(l => l.Latitude);
        Ignore(l => l.Longitude);
    }
}

But it doesn't work and never will. How I can solve this problem? What are the best practices in this situation?

Thank you