No, I don't think they would move KC from the division with Denver and Oakland. WAY too much history with those three teams. Unless they decided a LA-Oakland (Al Davis) rivalry would be too good to pass up.
I think the divisions are set for awhile no matter who moves, Colts, Vikings, Chargers...whoever. Besides, LA is more south than KC!