After a brief overview of asymptotically Lifshitz and hyperscaling violating Lifshitz backgrounds in holography, I will discuss the computation of the thermoelectric DC conductivities in such backgrounds. As I will show, the linearized fluctuations necessary to compute these conductivities turn on a source for the irrelevant energy flux operator, which leads to several subtleties in the procedure of holographic renormalization for the corresponding two-point functions. Different boundary conditions for the gauge field fluctuations will be considered, and I will discuss the conditions under which the near horizon prescription of Donos and Gauntlett produces the correct DC conductivities.