comp.lang.idl-pvwave archive
Messages from Usenet group comp.lang.idl-pvwave, compiled by Paulo Penteado

Home » Public Forums » archive » Re: Speeding Up Oracle DataBase Access with IDL DataMiner
Show: Today's Messages :: Show Polls :: Message Navigator
E-mail to friend 
Switch to threaded view of this topic Create a new topic Submit Reply
Re: Speeding Up Oracle DataBase Access with IDL DataMiner [message #45204] Mon, 22 August 2005 15:03
Randall  Skelton is currently offline  Randall Skelton
Messages: 31
Registered: October 2004
Member
Hi Chris,

So I use neither the Dataminer nor Oracle but access a large
(multi-terabyte) PostgreSQL database with IDL all the time.

Is this a case of the query your doing simply taking a long time to
execute (i.e. on the server) or a case of the volume of data being
returned is very, very large? If you execute the SQL query outside of
IDL with 'explain plan query', what do you get? Some quick tutorials
are at,

http://www.adp-gmbh.ch/ora/explainplan.html
http://www.evolt.org/article/Use_Oracle_s_Explain_Plan_to_Tu ne_Your_Queries/17/2986/
http://www.oracle-base.com/articles/8i/ExplainPlanUsage.php

and there are plenty of others on the web. This will give you an idea
of how long the query itself is taking to execute on the backend
server. If it is taking too long, you'll need to look at optimizing
the query by adding indexes or clever SQLisms. If it is a data volume
issue, then you may need to restrict yourself to subset of your data to
avoid excessive network bandwidth and/or memory swapping.

The inability to use IDL during your query is typical 'blocking'
behaviour. I don't believe that the dataminer supports non-blocking
communication with the backend SQL server.

Good luck,
Randall
Re: Speeding Up Oracle DataBase Access with IDL DataMiner [message #45208 is a reply to message #45204] Mon, 22 August 2005 13:54 Go to previous message
Michael Wallace is currently offline  Michael Wallace
Messages: 409
Registered: December 2003
Senior Member
> I would install the appropriate Oracle client on your machine (you can
> at the same time install Oracle's ODBC drivers), execute that query
> using SQLplus, and look at execution time. You may find that your query
> takes just as long in which case you need to either re-think your query
> or look at tuning your db. Or, you may find that your query executes
> much faster in which case you need to look at either how you are
> performing the query in dataminer or mucking around with ODBC drivers.

If you don't already have the client software, go download it now. You
can get a lot of details through the Oracle Enterprise Manager and
SQL*Plus. Your problem could be as simple as not having a key on the
columns your searching or not having analyzed your tables in a while
(both will lead to full table scans). If you fire off a typical query
in SQL*Plus, you can then watch it in the enterprise manager and see if
it's doing. That's probably the first step to figuring this out.

-Mike
Re: Speeding Up Oracle DataBase Access with IDL DataMiner [message #45210 is a reply to message #45208] Mon, 22 August 2005 13:44 Go to previous message
Rick Towler is currently offline  Rick Towler
Messages: 821
Registered: August 1998
Senior Member
Michael Wallace wrote:
>> 2) How might I go about speeding up the DataMiner querying
>> process? I've read in some papers, that tuning your database
>> driver is a possibile solution. But I've not found any references
>> to the setup that I'm using. I'm using the Merant 3.70 32-BIT
>> Oracle8 driver, to access an Oracle 9i database on a Solaris SunOS
>> 5.8. Admittedly, I don't know much about drivers, but does anyone
>> have any experience optimizing the performance of the Merant 3.70
>> drivers? Or do you know how I might got about tuning them, or
>> where I might get a newer compatible driver that is faster? Or
>> would you recommend using the MS drivers instead?
>
>
> I don't think the driver is the problem. I'd bet that this most likely
> an Oracle tuning problem. Tuning a database, especially Oracle, is very
> much an art and you often have to really study what's making it slow.
> While I don't think the driver has much to do with it, it'd be good to
> upgrade the driver to one that supports 9i. Take a look at
> http://www.orafaq.com/faqdbapf.htm for some general info about tuning
> and for specific questions, http://asktom.oracle.com is the best
> resource out there. Good luck!
>


I second Mike's suggestion. I would also try to narrow down the
bottleneck. Can you build your query in SQL and use another tool to
execute it?

I would install the appropriate Oracle client on your machine (you can
at the same time install Oracle's ODBC drivers), execute that query
using SQLplus, and look at execution time. You may find that your query
takes just as long in which case you need to either re-think your query
or look at tuning your db. Or, you may find that your query executes
much faster in which case you need to look at either how you are
performing the query in dataminer or mucking around with ODBC drivers.

If you want/need to go as far as db/sql tuning, you'll need to look into
more heavy duty tools. I like and use TOAD by Quest software and I'm
sure there are many others.

-Rick
Re: Speeding Up Oracle DataBase Access with IDL DataMiner [message #45211 is a reply to message #45210] Mon, 22 August 2005 13:24 Go to previous message
Michael Wallace is currently offline  Michael Wallace
Messages: 409
Registered: December 2003
Senior Member
> 2) How might I go about speeding up the DataMiner querying
> process? I've read in some papers, that tuning your database
> driver is a possibile solution. But I've not found any references
> to the setup that I'm using. I'm using the Merant 3.70 32-BIT
> Oracle8 driver, to access an Oracle 9i database on a Solaris SunOS
> 5.8. Admittedly, I don't know much about drivers, but does anyone
> have any experience optimizing the performance of the Merant 3.70
> drivers? Or do you know how I might got about tuning them, or
> where I might get a newer compatible driver that is faster? Or
> would you recommend using the MS drivers instead?


I don't think the driver is the problem. I'd bet that this most likely
an Oracle tuning problem. Tuning a database, especially Oracle, is very
much an art and you often have to really study what's making it slow.
While I don't think the driver has much to do with it, it'd be good to
upgrade the driver to one that supports 9i. Take a look at
http://www.orafaq.com/faqdbapf.htm for some general info about tuning
and for specific questions, http://asktom.oracle.com is the best
resource out there. Good luck!

-Mike
  Switch to threaded view of this topic Create a new topic Submit Reply
Previous Topic: Re: Check if a point is inside a polygon mesh
Next Topic: Re: Building Voxel arrays from png files (compression, analysis, and visualization)

-=] Back to Top [=-
[ Syndicate this forum (XML) ] [ RSS ] [ PDF ]

Current Time: Sun Oct 12 01:30:18 PDT 2025

Total time taken to generate the page: 0.56361 seconds