It seem that GroupBox can only contain one element, if I place more than one it's won't go inside(or get deleted in blend).
Is this by design or am I doing something wrong?
That sounds right to me. You'd need to put a Grid or Panel (StackPanel, WrapPanel, etc) as a child to define the layout.