I would not use a drill chuck with an endmill at all unless I was plunging straight down into the part, and even then it would have to be on an even surface with all of the tool engaged. Side loading your drill chuck will cause it to run out, and then you'll be left wondering why your holes are either in the wrong location, or blown out (oversize.).