element14 Community
element14 Community
    Register Log In
  • Site
  • Search
  • Log In Register
  • Members
    Members
    • Benefits of Membership
    • Achievement Levels
    • Members Area
    • Personal Blogs
    • Feedback and Support
    • What's New on element14
  • Learn
    Learn
    • Learning Center
    • eBooks
    • STEM Academy
    • Webinars, Training and Events
    • More
  • Technologies
    Technologies
    • 3D Printing
    • FPGA
    • Industrial Automation
    • Internet of Things
    • Power & Energy
    • Sensors
    • More
  • Challenges & Projects
    Challenges & Projects
    • Design Challenges
    • element14 presents
    • Project14
    • Arduino Projects
    • Raspberry Pi Projects
    • More
  • Products
    Products
    • Arduino
    • Dev Tools
    • Manufacturers
    • Raspberry Pi
    • RoadTests & Reviews
    • Avnet Boards Community
    • More
  • Store
    Store
    • Visit Your Store
    • Choose Another Store
      • Europe
      •  Austria (German)
      •  Belgium (Dutch, French)
      •  Bulgaria (Bulgarian)
      •  Czech Republic (Czech)
      •  Denmark (Danish)
      •  Estonia (Estonian)
      •  Finland (Finnish)
      •  France (French)
      •  Germany (German)
      •  Hungary (Hungarian)
      •  Ireland
      •  Israel
      •  Italy (Italian)
      •  Latvia (Latvian)
      •  
      •  Lithuania (Lithuanian)
      •  Netherlands (Dutch)
      •  Norway (Norwegian)
      •  Poland (Polish)
      •  Portugal (Portuguese)
      •  Romania (Romanian)
      •  Russia (Russian)
      •  Slovakia (Slovak)
      •  Slovenia (Slovenian)
      •  Spain (Spanish)
      •  Sweden (Swedish)
      •  Switzerland(German, French)
      •  Turkey (Turkish)
      •  United Kingdom
      • Asia Pacific
      •  Australia
      •  China
      •  Hong Kong
      •  India
      •  Korea (Korean)
      •  Malaysia
      •  New Zealand
      •  Philippines
      •  Singapore
      •  Taiwan
      •  Thailand (Thai)
      • Americas
      •  Brazil (Portuguese)
      •  Canada
      •  Mexico (Spanish)
      •  United States
      Can't find the country/region you're looking for? Visit our export site or find a local distributor.
  • Translate
  • Profile
Autodesk EAGLE
  • Products
  • More
Autodesk EAGLE
Forum CadSoft EAGLE development team developing XML format for schematic, layout and parts libraries!
  • Blog
  • Forums
  • Documents
  • Events
  • Members
  • Mentions
  • Sub-Groups
  • Tags
  • More
  • Cancel
  • New
Autodesk EAGLE requires membership for participation - click to join
Actions
  • Share
  • More
  • Cancel
Forum Thread Details
  • Replies 30 replies
  • Subscribers 87 subscribers
  • Views 1269 views
  • Users 0 members are here
  • farnell
  • pcb_layout
  • pcb
  • open
  • Design
  • source
  • open_source_hardware
  • eagle_pcb
  • cadsoft
Related

CadSoft EAGLE development team developing XML format for schematic, layout and parts libraries!

Former Member
Former Member over 11 years ago

hello makers -

 

this is my first post here, i'm the senior editor at MAKE magazine and also the creative director at adafruit. i've been part of a growing movement called "open-source hardware" for the last 5 years or so. today we just got some great news from the CadSoft EAGLE development team about the their long term commitment to text based file formats in the world of electronics development. with their permission i am posting this here and on MAKE (as well as adafruit). it's extremely exciting for those of us who wanted an XML format for files and we're thrilled CadSoft EAGLE has said they're committed to it!

 

here's the overview of what we learned:

 

  • CadSoft EAGLE (our preferred schematic/layout software) has told us they are committed to a text based format in the long term.
  • The CadSoft EAGLE development team is developing a new format for schematic, layout and parts libraries that is XML, this means every object and line will be written out in text description.
  • You won't have to worry about binary file corruption, you will be able to hand-edit or generate schematics and layouts and of course the magic of version-control (such as github) will be easier than ever with real text 'diff's!
  • This will be a fully documented format and also of course a converter for old CadSoft EAGLE binary-type formats.

 

 

this is a great direction and i encourage you to support EAGLE as you decide which tools to use now and in the future. but that's not all, i've chatted with the element-14 folks and they're all set up for your feedback, if they're very interested in Maker voices their product development. so here's your chance folks!

 

cheers,

pt

  • Reply
  • Cancel
  • Cancel

Top Replies

  • Former Member
    Former Member over 11 years ago +1

    For me at least, it's difficult to argue with the "goodness" of XML.  The Devil, however, is in the details.  XML does not make the system "open" if the copyright to the schema is held close…

  • Former Member
    Former Member over 11 years ago

    Personally I don't think that is a good idea. Xml itself introduces ambiguitiy, as does text. It is also language based (and large, slow to parse and all the regular issues). I would way rather they open the binary formats if they haven't already. The existing text formats (like the spice format) work fine and are way more readable than xml as is.

     

    I understand I may be a minority in this view : ).

    • Cancel
    • Vote Up 0 Vote Down
    • Reply
    • Cancel
  • Former Member
    Former Member over 11 years ago in reply to Former Member

    it doesnt take longer to parse text than to parse binary.  XML is much less ambiguous than text. also, XML -is- text

    • Cancel
    • Vote Up 0 Vote Down
    • Reply
    • Cancel
  • Former Member
    Former Member over 11 years ago in reply to Former Member

    Well seeing as binary can just be a cast I'd say it is slower - I agree it doesn't have to be 'too slow', but it often ends up that way.

     

    XML is more ambigous than a good documented text format imo - eg like spice, PS etc. For example you have tags vs attributes, or unicode vs ascii, etc. That can be doc'd, but as a user you have to remember if it is one, the other, or both. And that is 'if' it is doc'd properly. That said, it is binary now, not text - I think they use text for some of the config stuff (like hotkeys iirc) though, which is why I mentioned it...

     

    Most tools for xml formats have problems accepting files that are 'legal' as far as the schema once the format becomes a bit large. I've had lots of issues with that in both SVG and XAML, and of course HTML seems to be hard for everyone to get right on the edges (even harder for editors). With a binary format it tends to blow up or work, which imo is more desirable.

     

    As far as viewing, you can view it in Eagle. I think the format is mostly interesting to those who want to tool against it.

     

    The one major plus of a text format is version control. You could have a tool that converts to and from open binary <> test/xml for that, but I agree that is less optimal. So one large point for text formats there : ).

     

    Ah well, I'll take open xml is over closed binary any day, so I'm with you for sure... Just feel 'open binary' is never given fair consideration. Ironically I think its main strength is portability - not of the parser tool, but of the exact meaning intended.

    • Cancel
    • Vote Up 0 Vote Down
    • Reply
    • Cancel
  • Former Member
    Former Member over 11 years ago in reply to Former Member

    Well, I for one will be very glad to see an XML file format implemented.  Back in my Cadence days I wrote a Java-based netlist parser app to convert between languages (mostly SPICE, Spectre, Verilog-AMS and VHDL-AMS) using XML as an intermediary format and XSL Transforms to interact with the source and generate the destination formats.

     

    Aside: I hate SPICE precisely because it is totally ambiguous, poorly documented and incompatible between all the permutations and combinations out there between EDA platforms.  At least the hierarchical nature of properly formatted XML is parsable independent of the content or even a formally defined schema.

     

    Aside 2: IMHO, if you have to use regular expressions to get at the atomic structures contained in an "XML" format like you do in SVG, it's not proper XML.  Things like coordinates should be accessible as discrete XML elements or attributes accessible through simple XSLT code.

     

    If size is a concern (which it was when dealing with GB-size netlists) you can use a generic zip algorithm to compress the text and serialize the I/O.  As a bonus you get encryption, authentication, error correction and all that other good serialization infrastructure for free.  It'll add a layer of I/O complexity for revision control, but if the RC supports generic zip-diffs, all text formats will benefit, not just XML.  You also get ascii vs unicode vs localization controls for free with most XML-based APIs, independent of whether the tools (don't) have it.

     

    Aside 3: Avoid the DOM-style XML readers that suck in the whole XML content before you can do anything with the content.  You're much better off using a SAX approach to create your own (sparse) data structures on the fly, with the added benefit that when data's corrupt you can more easily identify and work around where things are broken in the stream.

    • Cancel
    • Vote Up 0 Vote Down
    • Reply
    • Cancel
  • Former Member
    Former Member over 11 years ago in reply to Former Member

    the file only has to be parsed on opening and closing. it doesn't affect anything else. "badly documented XML is as bad as badly documented text. this is something that doesn't even exist so no one can say it's ambiguous, yet we aren't talking about HTML. we are talking about the file format Eagle CAD, which will be used by Eagle CAD for saving and opening files.

     

    Robin Debreuil wrote:


    -The one major plus of a text format is version control. You could have a tool that converts to and from open binary <> test/xml for that, but I agree that is less optimal. So one large point for text formats there : ).

     

    -I'll take open xml is over closed binary any day, so I'm with you for sure...

     

    yay!

     

    cheers,

    pt

    • Cancel
    • Vote Up 0 Vote Down
    • Reply
    • Cancel
  • Former Member
    Former Member over 11 years ago in reply to Former Member

    I'm super happy it is opening, and I think there is a real chance I will use it for something that will be useful to me... so double yaay! I should have led off with that, sorry : ).

     

    For the record, I'm not saying use text instead of xml - I'm saying binary has a lot of advantages you lose and xml has potential pitfalls. If you do everything right xml can be reasonable, but if most major uses of xml are 'doing it wrong' then maybe it needs to be a bit more explicit and enforceable. I can deal with it though, minor quibble. Eagle is an awesome dev tool - regardless of how it is serialized : ).

    • Cancel
    • Vote Up 0 Vote Down
    • Reply
    • Cancel
  • Former Member
    Former Member over 11 years ago

    I'm all for openness and transparency in data files. If the data in your text file is large, though, then it can get pretty nasty for a human to parse and edit. I consitently deal with verilog netlists that are on the order of 100Mb in size for our ASICs at work. In fact, lots of files for my job are text (SPEF, netlist, DEF, LEF, LIB). We don't edit netlists by had because they are too large and complicated. We use EDA tools to manually manipulate netlists with languages like TCL (edit netlist disconnect, edit netlist connect, edit netlist create and_gate). I would recommend supporting the reading and writing of compressed XML files out of the gate. Why waste 100MB of disk space when gzip will compress it down to 2MB? Most linux distros command line utils/editors support auto decompress of gzipped files. But I guess that doesn't apply to windows very well. Since all my EDA work is on linux (none of the asic tools support windows), I tend to foget it exists for other eda industries like PCB.

     

    I don't think you can claim checking them into a revision control system as a feature/positive. The text in a file can look completely different to "diff", but still represent the exact same design data. The same net coordinates can live on line 5 or line 5,000,000 and still represent the same thing. We check in our text verilog netlists to RCS at work, but the diffs usually end up being 95% different despite only having 3 new logic gates added. Might as well been a binary file at those diff rates. Now if you can guarentee exact text formatting and order from output to output, then this diff issue obviously goes away.

     

    That being said, it is great when I run across an EDA vendor using a straight forward text file for a input or output file. Did you board dimentions change, but you want to keep all the x,y coordinates of your components? Start up a new board and draw the dimenstions, then save to a text file. Rip out the old componet coordinate section from the old text file and and place it in the new one and vola! Instant component placements! ( this is a somewhat bad example since you can just take your board file and edit the dimensions with components in place - but I think you get my point).

     

    BTW - I love eagle cad. Any chance you guys could get a graphics designer to re-work your icons? Nothing says polished tool like professional and modern icons.

    • Cancel
    • Vote Up 0 Vote Down
    • Reply
    • Cancel
  • Former Member
    Former Member over 11 years ago in reply to Former Member

    I'm cautiously optimistic that they'll do the right thing.  The major (ab)uses of XML can get away with the mutated forms they do precisely because they are major.  EDA doesn't have that luxury.

     

    I've found that XML works best for separating form (e.g. SPICE vs CDL vs Verilog language quirks) from function (i.e. instantiation, connectivity, parametrization, etc). Its strengths really shine when you need to do complex scripted interaction with the data.  Pick a language (aside from Cadence's SKILL ) and you'll find at least basic XML parsing hooks.  No need for custom regexp, antlr, javacc, binary-reading parsers for the N+1th platform variation.  You can even test XSLT works-in-progress via your browser of choice!

    • Cancel
    • Vote Up 0 Vote Down
    • Reply
    • Cancel
  • Former Member
    Former Member over 11 years ago in reply to Former Member

    XML diff works best if you enforce lang-based sorting of the hierarchy.  For example, if you have a lib-cells-views-insts structure, the cells will always appear in the same cell-name alphanum order, the views will always appear in the same view-name alphanum order, and most importantly all the instances will appear in the inst-name alphanum sorted order.  For coordinates-based diffs, graphical structures could stick to a numerically-sorted order, like X-coord then Y-coord, or worst case a brute-force XOR/intersection operation using something like Java's built-in Area class boolean ops.

     

    Worst-case, build the enforced sorting mechanism into the revision control front-end.  There's always a way!

    • Cancel
    • Vote Up 0 Vote Down
    • Reply
    • Cancel
  • Former Member
    Former Member over 11 years ago in reply to Former Member

    i'm excited and the goal of this post was to get people talking about this - success!

    • Cancel
    • Vote Up 0 Vote Down
    • Reply
    • Cancel
>
element14 Community

element14 is the first online community specifically for engineers. Connect with your peers and get expert answers to your questions.

  • Members
  • Learn
  • Technologies
  • Challenges & Projects
  • Products
  • Store
  • About Us
  • Feedback & Support
  • FAQs
  • Terms of Use
  • Privacy Policy
  • Legal and Copyright Notices
  • Sitemap
  • Cookies

An Avnet Company © 2022 Premier Farnell Limited. All Rights Reserved.

Premier Farnell Ltd, registered in England and Wales (no 00876412), registered office: Farnell House, Forge Lane, Leeds LS12 2NE.

ICP 备案号 10220084.

Follow element14

  • Facebook
  • Twitter
  • linkedin
  • YouTube